2023-07-22 14:05:52,594 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 14:05:52,879 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4 2023-07-22 14:05:52,879 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-22 14:05:52,924 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 14:05:53,181 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 14:05:53,182 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07, deleteOnExit=true 2023-07-22 14:05:53,182 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 14:05:53,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/test.cache.data in system properties and HBase conf 2023-07-22 14:05:53,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 14:05:53,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop.log.dir in system properties and HBase conf 2023-07-22 14:05:53,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 14:05:53,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 14:05:53,185 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 14:05:53,575 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 14:05:53,579 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 14:05:53,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 14:05:53,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 14:05:53,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 14:05:53,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 14:05:53,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 14:05:53,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 14:05:53,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 14:05:53,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 14:05:53,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/nfs.dump.dir in system properties and HBase conf 2023-07-22 14:05:53,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir in system properties and HBase conf 2023-07-22 14:05:53,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 14:05:53,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 14:05:53,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 14:05:54,172 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 14:05:54,176 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 14:05:54,446 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 14:05:54,632 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 14:05:54,651 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:05:54,691 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:05:54,728 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_localhost_44107_hdfs____r82b6q/webapp 2023-07-22 14:05:54,869 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44107 2023-07-22 14:05:54,917 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 14:05:54,917 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 14:05:55,492 WARN [Listener at localhost/42431] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 14:05:55,577 WARN [Listener at localhost/42431] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 14:05:55,602 WARN [Listener at localhost/42431] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:05:55,610 INFO [Listener at localhost/42431] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:05:55,617 INFO [Listener at localhost/42431] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_localhost_35081_datanode____iv2oz2/webapp 2023-07-22 14:05:55,792 INFO [Listener at localhost/42431] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35081 2023-07-22 14:05:56,271 WARN [Listener at localhost/43573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 14:05:56,303 WARN [Listener at localhost/43573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 14:05:56,311 WARN [Listener at localhost/43573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:05:56,314 INFO [Listener at localhost/43573] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:05:56,322 INFO [Listener at localhost/43573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_localhost_35891_datanode____.34st4b/webapp 2023-07-22 14:05:56,444 INFO [Listener at localhost/43573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35891 2023-07-22 14:05:56,459 WARN [Listener at localhost/44289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 14:05:56,501 WARN [Listener at localhost/44289] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 14:05:56,505 WARN [Listener at localhost/44289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:05:56,507 INFO [Listener at localhost/44289] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:05:56,528 INFO [Listener at localhost/44289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_localhost_33327_datanode____.agose9/webapp 2023-07-22 14:05:56,688 INFO [Listener at localhost/44289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33327 2023-07-22 14:05:56,719 WARN [Listener at localhost/44727] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 14:05:56,968 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdec1c0c12482dee6: Processing first storage report for DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d from datanode fda4813d-bb8d-4de5-b167-6293f6c9e9d3 2023-07-22 14:05:56,970 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdec1c0c12482dee6: from storage DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d node DatanodeRegistration(127.0.0.1:39855, datanodeUuid=fda4813d-bb8d-4de5-b167-6293f6c9e9d3, infoPort=34539, infoSecurePort=0, ipcPort=44289, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-22 14:05:56,970 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x60335799e8f7db4f: Processing first storage report for DS-c7022bae-ae81-46c2-84f5-c47090d9ab37 from datanode 8255682f-0042-40f2-8e91-12d01a9bb9d0 2023-07-22 14:05:56,970 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x60335799e8f7db4f: from storage DS-c7022bae-ae81-46c2-84f5-c47090d9ab37 node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=8255682f-0042-40f2-8e91-12d01a9bb9d0, infoPort=42465, infoSecurePort=0, ipcPort=44727, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6cc184efacf23cb4: Processing first storage report for DS-27ab789a-8991-4e22-aa88-b67029b31f96 from datanode 771f0c60-053e-4de8-b89e-1ee650bfc48c 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6cc184efacf23cb4: from storage DS-27ab789a-8991-4e22-aa88-b67029b31f96 node DatanodeRegistration(127.0.0.1:45107, datanodeUuid=771f0c60-053e-4de8-b89e-1ee650bfc48c, infoPort=41199, infoSecurePort=0, ipcPort=43573, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdec1c0c12482dee6: Processing first storage report for DS-47e92813-ee57-46b4-885b-30561fad73cc from datanode fda4813d-bb8d-4de5-b167-6293f6c9e9d3 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdec1c0c12482dee6: from storage DS-47e92813-ee57-46b4-885b-30561fad73cc node DatanodeRegistration(127.0.0.1:39855, datanodeUuid=fda4813d-bb8d-4de5-b167-6293f6c9e9d3, infoPort=34539, infoSecurePort=0, ipcPort=44289, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6cc184efacf23cb4: Processing first storage report for DS-8e7e7bd1-9122-453f-a371-53b5fd9e3e85 from datanode 771f0c60-053e-4de8-b89e-1ee650bfc48c 2023-07-22 14:05:56,971 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6cc184efacf23cb4: from storage DS-8e7e7bd1-9122-453f-a371-53b5fd9e3e85 node DatanodeRegistration(127.0.0.1:45107, datanodeUuid=771f0c60-053e-4de8-b89e-1ee650bfc48c, infoPort=41199, infoSecurePort=0, ipcPort=43573, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 14:05:56,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x60335799e8f7db4f: Processing first storage report for DS-43d94198-222b-4569-9b52-dc9a44b9ba24 from datanode 8255682f-0042-40f2-8e91-12d01a9bb9d0 2023-07-22 14:05:56,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x60335799e8f7db4f: from storage DS-43d94198-222b-4569-9b52-dc9a44b9ba24 node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=8255682f-0042-40f2-8e91-12d01a9bb9d0, infoPort=42465, infoSecurePort=0, ipcPort=44727, storageInfo=lv=-57;cid=testClusterID;nsid=1711559571;c=1690034754243), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 14:05:57,183 DEBUG [Listener at localhost/44727] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4 2023-07-22 14:05:57,278 INFO [Listener at localhost/44727] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/zookeeper_0, clientPort=59777, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 14:05:57,295 INFO [Listener at localhost/44727] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59777 2023-07-22 14:05:57,306 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:57,309 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:57,988 INFO [Listener at localhost/44727] util.FSUtils(471): Created version file at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 with version=8 2023-07-22 14:05:57,988 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/hbase-staging 2023-07-22 14:05:58,350 INFO [Listener at localhost/44727] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 14:05:58,924 INFO [Listener at localhost/44727] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 14:05:58,958 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:58,959 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:58,959 INFO [Listener at localhost/44727] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 14:05:58,959 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:58,960 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 14:05:59,138 INFO [Listener at localhost/44727] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 14:05:59,238 DEBUG [Listener at localhost/44727] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 14:05:59,345 INFO [Listener at localhost/44727] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36585 2023-07-22 14:05:59,358 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,361 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,387 INFO [Listener at localhost/44727] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36585 connecting to ZooKeeper ensemble=127.0.0.1:59777 2023-07-22 14:05:59,447 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:365850x0, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 14:05:59,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36585-0x1018d5a618a0000 connected 2023-07-22 14:05:59,504 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 14:05:59,505 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:05:59,520 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 14:05:59,530 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36585 2023-07-22 14:05:59,531 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36585 2023-07-22 14:05:59,534 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36585 2023-07-22 14:05:59,538 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36585 2023-07-22 14:05:59,539 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36585 2023-07-22 14:05:59,546 INFO [Listener at localhost/44727] master.HMaster(444): hbase.rootdir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, hbase.cluster.distributed=false 2023-07-22 14:05:59,617 INFO [Listener at localhost/44727] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 14:05:59,617 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,617 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,617 INFO [Listener at localhost/44727] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 14:05:59,618 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,618 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 14:05:59,623 INFO [Listener at localhost/44727] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 14:05:59,627 INFO [Listener at localhost/44727] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45383 2023-07-22 14:05:59,630 INFO [Listener at localhost/44727] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 14:05:59,639 DEBUG [Listener at localhost/44727] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 14:05:59,640 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,642 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,645 INFO [Listener at localhost/44727] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45383 connecting to ZooKeeper ensemble=127.0.0.1:59777 2023-07-22 14:05:59,650 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:453830x0, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 14:05:59,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45383-0x1018d5a618a0001 connected 2023-07-22 14:05:59,651 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 14:05:59,653 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:05:59,654 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 14:05:59,659 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45383 2023-07-22 14:05:59,659 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45383 2023-07-22 14:05:59,663 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45383 2023-07-22 14:05:59,663 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45383 2023-07-22 14:05:59,664 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45383 2023-07-22 14:05:59,682 INFO [Listener at localhost/44727] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 14:05:59,683 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,683 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,684 INFO [Listener at localhost/44727] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 14:05:59,684 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,684 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 14:05:59,684 INFO [Listener at localhost/44727] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 14:05:59,688 INFO [Listener at localhost/44727] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39735 2023-07-22 14:05:59,688 INFO [Listener at localhost/44727] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 14:05:59,690 DEBUG [Listener at localhost/44727] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 14:05:59,691 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,694 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,696 INFO [Listener at localhost/44727] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39735 connecting to ZooKeeper ensemble=127.0.0.1:59777 2023-07-22 14:05:59,705 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:397350x0, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 14:05:59,706 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:397350x0, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 14:05:59,708 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:397350x0, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:05:59,709 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:397350x0, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 14:05:59,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39735-0x1018d5a618a0002 connected 2023-07-22 14:05:59,717 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39735 2023-07-22 14:05:59,718 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39735 2023-07-22 14:05:59,719 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39735 2023-07-22 14:05:59,722 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39735 2023-07-22 14:05:59,723 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39735 2023-07-22 14:05:59,742 INFO [Listener at localhost/44727] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 14:05:59,742 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,742 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,742 INFO [Listener at localhost/44727] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 14:05:59,743 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 14:05:59,743 INFO [Listener at localhost/44727] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 14:05:59,743 INFO [Listener at localhost/44727] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 14:05:59,747 INFO [Listener at localhost/44727] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45699 2023-07-22 14:05:59,747 INFO [Listener at localhost/44727] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 14:05:59,751 DEBUG [Listener at localhost/44727] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 14:05:59,753 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,755 INFO [Listener at localhost/44727] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:05:59,758 INFO [Listener at localhost/44727] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45699 connecting to ZooKeeper ensemble=127.0.0.1:59777 2023-07-22 14:05:59,763 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:456990x0, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 14:05:59,764 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:456990x0, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 14:05:59,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45699-0x1018d5a618a0003 connected 2023-07-22 14:05:59,769 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:05:59,770 DEBUG [Listener at localhost/44727] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 14:05:59,775 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45699 2023-07-22 14:05:59,777 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45699 2023-07-22 14:05:59,780 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45699 2023-07-22 14:05:59,781 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45699 2023-07-22 14:05:59,782 DEBUG [Listener at localhost/44727] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45699 2023-07-22 14:05:59,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:05:59,800 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 14:05:59,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:05:59,823 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 14:05:59,823 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 14:05:59,823 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 14:05:59,823 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 14:05:59,825 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:05:59,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 14:05:59,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36585,1690034758169 from backup master directory 2023-07-22 14:05:59,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 14:05:59,834 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:05:59,834 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 14:05:59,836 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 14:05:59,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:05:59,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 14:05:59,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 14:05:59,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/hbase.id with ID: 0ffe71c2-87e0-45c5-aa98-e085d5c5aa9d 2023-07-22 14:06:00,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 14:06:00,045 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:00,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2853067e to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:00,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@616c3d53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:00,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:00,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 14:06:00,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 14:06:00,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 14:06:00,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 14:06:00,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 14:06:00,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 14:06:00,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store-tmp 2023-07-22 14:06:00,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:00,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 14:06:00,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:06:00,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:06:00,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 14:06:00,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:06:00,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:06:00,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 14:06:00,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/WALs/jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:06:00,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36585%2C1690034758169, suffix=, logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/WALs/jenkins-hbase4.apache.org,36585,1690034758169, archiveDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/oldWALs, maxLogs=10 2023-07-22 14:06:00,469 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK] 2023-07-22 14:06:00,469 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK] 2023-07-22 14:06:00,469 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK] 2023-07-22 14:06:00,481 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 14:06:00,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/WALs/jenkins-hbase4.apache.org,36585,1690034758169/jenkins-hbase4.apache.org%2C36585%2C1690034758169.1690034760409 2023-07-22 14:06:00,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK], DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK], DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK]] 2023-07-22 14:06:00,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 14:06:00,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:00,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,662 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,669 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 14:06:00,705 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 14:06:00,720 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:00,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 14:06:00,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:00,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66682438, jitterRate=-0.006354242563247681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:00,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 14:06:00,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 14:06:00,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 14:06:00,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 14:06:00,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 14:06:00,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 14:06:00,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-07-22 14:06:00,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 14:06:00,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 14:06:00,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 14:06:00,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 14:06:00,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 14:06:00,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 14:06:00,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 14:06:00,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 14:06:00,942 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:00,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 14:06:00,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 14:06:00,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 14:06:00,971 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 14:06:00,972 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 14:06:00,972 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 14:06:00,972 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 14:06:00,972 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:00,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36585,1690034758169, sessionid=0x1018d5a618a0000, setting cluster-up flag (Was=false) 2023-07-22 14:06:00,997 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:01,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 14:06:01,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:06:01,012 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:01,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 14:06:01,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:06:01,028 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp 2023-07-22 14:06:01,092 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(951): ClusterId : 0ffe71c2-87e0-45c5-aa98-e085d5c5aa9d 2023-07-22 14:06:01,092 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(951): ClusterId : 0ffe71c2-87e0-45c5-aa98-e085d5c5aa9d 2023-07-22 14:06:01,095 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(951): ClusterId : 0ffe71c2-87e0-45c5-aa98-e085d5c5aa9d 2023-07-22 14:06:01,101 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 14:06:01,101 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 14:06:01,101 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 14:06:01,109 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 14:06:01,109 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 14:06:01,110 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 14:06:01,110 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 14:06:01,116 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 14:06:01,116 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 14:06:01,119 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 14:06:01,120 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 14:06:01,125 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 14:06:01,119 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ReadOnlyZKClient(139): Connect 0x2a7830d4 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:01,127 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ReadOnlyZKClient(139): Connect 0x3c1c4d65 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:01,128 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ReadOnlyZKClient(139): Connect 0x4ccadd34 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:01,168 DEBUG [RS:2;jenkins-hbase4:45699] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d8c2b03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:01,169 DEBUG [RS:2;jenkins-hbase4:45699] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34163ab7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 14:06:01,180 DEBUG [RS:1;jenkins-hbase4:39735] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bdca91d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:01,180 DEBUG [RS:1;jenkins-hbase4:39735] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f4d1d9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 14:06:01,183 DEBUG [RS:0;jenkins-hbase4:45383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@791ed482, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:01,183 DEBUG [RS:0;jenkins-hbase4:45383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6edd913a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 14:06:01,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 14:06:01,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:01,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 14:06:01,208 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45699 2023-07-22 14:06:01,213 INFO [RS:2;jenkins-hbase4:45699] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 14:06:01,213 INFO [RS:2;jenkins-hbase4:45699] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 14:06:01,213 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 14:06:01,214 INFO [RS:2;jenkins-hbase4:45699] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:01,216 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 14:06:01,220 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:45699, startcode=1690034759741 2023-07-22 14:06:01,244 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39735 2023-07-22 14:06:01,245 INFO [RS:1;jenkins-hbase4:39735] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 14:06:01,246 INFO [RS:1;jenkins-hbase4:39735] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 14:06:01,246 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 14:06:01,246 INFO [RS:1;jenkins-hbase4:39735] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:01,246 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 14:06:01,247 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45383 2023-07-22 14:06:01,247 INFO [RS:0;jenkins-hbase4:45383] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 14:06:01,247 INFO [RS:0;jenkins-hbase4:45383] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 14:06:01,247 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:39735, startcode=1690034759682 2023-07-22 14:06:01,247 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 14:06:01,248 INFO [RS:0;jenkins-hbase4:45383] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:01,248 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 14:06:01,249 DEBUG [RS:1;jenkins-hbase4:39735] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 14:06:01,249 DEBUG [RS:2;jenkins-hbase4:45699] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 14:06:01,250 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:45383, startcode=1690034759616 2023-07-22 14:06:01,251 DEBUG [RS:0;jenkins-hbase4:45383] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 14:06:01,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 14:06:01,321 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50099, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 14:06:01,328 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49967, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 14:06:01,321 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36377, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 14:06:01,333 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 14:06:01,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 14:06:01,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,345 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 14:06:01,345 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 14:06:01,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690034791351 2023-07-22 14:06:01,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 14:06:01,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 14:06:01,369 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 14:06:01,370 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 14:06:01,377 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:01,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 14:06:01,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 14:06:01,379 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 14:06:01,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 14:06:01,379 WARN [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 14:06:01,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 14:06:01,380 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 14:06:01,379 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 14:06:01,380 WARN [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 14:06:01,380 WARN [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 14:06:01,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 14:06:01,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 14:06:01,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 14:06:01,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 14:06:01,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 14:06:01,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690034761390,5,FailOnTimeoutGroup] 2023-07-22 14:06:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690034761391,5,FailOnTimeoutGroup] 2023-07-22 14:06:01,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 14:06:01,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,434 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:01,435 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:01,435 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:01,483 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:39735, startcode=1690034759682 2023-07-22 14:06:01,483 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:45383, startcode=1690034759616 2023-07-22 14:06:01,483 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36585,1690034758169 with isa=jenkins-hbase4.apache.org/172.31.14.131:45699, startcode=1690034759741 2023-07-22 14:06:01,492 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:01,493 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,495 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 14:06:01,499 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/info 2023-07-22 14:06:01,500 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 14:06:01,502 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,504 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:01,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:01,504 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42431 2023-07-22 14:06:01,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36585] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 14:06:01,504 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 14:06:01,504 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:01,505 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42431 2023-07-22 14:06:01,505 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 14:06:01,506 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:01,506 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42431 2023-07-22 14:06:01,506 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 14:06:01,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/rep_barrier 2023-07-22 14:06:01,511 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 14:06:01,512 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:06:01,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:01,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 14:06:01,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/table 2023-07-22 14:06:01,516 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ZKUtil(162): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,516 WARN [RS:0;jenkins-hbase4:45383] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 14:06:01,516 INFO [RS:0;jenkins-hbase4:45383] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 14:06:01,516 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 14:06:01,519 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ZKUtil(162): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,520 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ZKUtil(162): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,520 WARN [RS:1;jenkins-hbase4:39735] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 14:06:01,520 WARN [RS:2;jenkins-hbase4:45699] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 14:06:01,521 INFO [RS:1;jenkins-hbase4:39735] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 14:06:01,521 INFO [RS:2;jenkins-hbase4:45699] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 14:06:01,521 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,522 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:01,522 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45383,1690034759616] 2023-07-22 14:06:01,526 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45699,1690034759741] 2023-07-22 14:06:01,528 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39735,1690034759682] 2023-07-22 14:06:01,528 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740 2023-07-22 14:06:01,532 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740 2023-07-22 14:06:01,536 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ZKUtil(162): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,537 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ZKUtil(162): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,537 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ZKUtil(162): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,537 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ZKUtil(162): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,538 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ZKUtil(162): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,538 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 14:06:01,538 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ZKUtil(162): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,541 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 14:06:01,544 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ZKUtil(162): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,545 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ZKUtil(162): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,545 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ZKUtil(162): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,560 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 14:06:01,560 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:01,561 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63694972, jitterRate=-0.05087095499038696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 14:06:01,562 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 14:06:01,562 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 14:06:01,562 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 14:06:01,562 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 14:06:01,562 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 14:06:01,562 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 14:06:01,562 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 14:06:01,562 DEBUG [RS:2;jenkins-hbase4:45699] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 14:06:01,567 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 14:06:01,567 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 14:06:01,574 INFO [RS:2;jenkins-hbase4:45699] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 14:06:01,574 INFO [RS:1;jenkins-hbase4:39735] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 14:06:01,578 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 14:06:01,578 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 14:06:01,586 INFO [RS:0;jenkins-hbase4:45383] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 14:06:01,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 14:06:01,614 INFO [RS:1;jenkins-hbase4:39735] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 14:06:01,624 INFO [RS:0;jenkins-hbase4:45383] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 14:06:01,625 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 14:06:01,627 INFO [RS:2;jenkins-hbase4:45699] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 14:06:01,630 INFO [RS:0;jenkins-hbase4:45383] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 14:06:01,630 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,633 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 14:06:01,639 INFO [RS:2;jenkins-hbase4:45699] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 14:06:01,651 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 14:06:01,660 INFO [RS:1;jenkins-hbase4:39735] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 14:06:01,639 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,676 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 14:06:01,660 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,684 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 14:06:01,690 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,690 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,690 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,690 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,691 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,691 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 14:06:01,692 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,692 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,693 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,693 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,693 DEBUG [RS:1;jenkins-hbase4:39735] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,693 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,693 DEBUG [RS:2;jenkins-hbase4:45699] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,713 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,713 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,713 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,713 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,713 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,714 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 14:06:01,714 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,714 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,714 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,714 DEBUG [RS:0;jenkins-hbase4:45383] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 14:06:01,718 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,719 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,719 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,730 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,731 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,731 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,743 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,743 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,743 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,754 INFO [RS:2;jenkins-hbase4:45699] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 14:06:01,762 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45699,1690034759741-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,763 INFO [RS:0;jenkins-hbase4:45383] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 14:06:01,763 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45383,1690034759616-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,756 INFO [RS:1;jenkins-hbase4:39735] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 14:06:01,766 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39735,1690034759682-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:01,791 DEBUG [jenkins-hbase4:36585] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 14:06:01,796 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:01,803 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:01,804 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:01,804 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:01,804 DEBUG [jenkins-hbase4:36585] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:01,822 INFO [RS:0;jenkins-hbase4:45383] regionserver.Replication(203): jenkins-hbase4.apache.org,45383,1690034759616 started 2023-07-22 14:06:01,823 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45383,1690034759616, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45383, sessionid=0x1018d5a618a0001 2023-07-22 14:06:01,823 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45383,1690034759616, state=OPENING 2023-07-22 14:06:01,831 INFO [RS:1;jenkins-hbase4:39735] regionserver.Replication(203): jenkins-hbase4.apache.org,39735,1690034759682 started 2023-07-22 14:06:01,831 INFO [RS:2;jenkins-hbase4:45699] regionserver.Replication(203): jenkins-hbase4.apache.org,45699,1690034759741 started 2023-07-22 14:06:01,831 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 14:06:01,831 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45699,1690034759741, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45699, sessionid=0x1018d5a618a0003 2023-07-22 14:06:01,831 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39735,1690034759682, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39735, sessionid=0x1018d5a618a0002 2023-07-22 14:06:01,832 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 14:06:01,832 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 14:06:01,842 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 14:06:01,832 DEBUG [RS:2;jenkins-hbase4:45699] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,843 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45699,1690034759741' 2023-07-22 14:06:01,843 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 14:06:01,845 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:01,845 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 14:06:01,832 DEBUG [RS:0;jenkins-hbase4:45383] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,846 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 14:06:01,846 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 14:06:01,843 DEBUG [RS:1;jenkins-hbase4:39735] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,847 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39735,1690034759682' 2023-07-22 14:06:01,847 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 14:06:01,848 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 14:06:01,849 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 14:06:01,847 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 14:06:01,849 DEBUG [RS:2;jenkins-hbase4:45699] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:01,849 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45699,1690034759741' 2023-07-22 14:06:01,849 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:01,846 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45383,1690034759616' 2023-07-22 14:06:01,849 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 14:06:01,849 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 14:06:01,849 DEBUG [RS:1;jenkins-hbase4:39735] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:01,850 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39735,1690034759682' 2023-07-22 14:06:01,850 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:01,851 DEBUG [RS:2;jenkins-hbase4:45699] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:01,851 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 14:06:01,851 DEBUG [RS:1;jenkins-hbase4:39735] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:01,851 DEBUG [RS:2;jenkins-hbase4:45699] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 14:06:01,851 INFO [RS:2;jenkins-hbase4:45699] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 14:06:01,852 INFO [RS:2;jenkins-hbase4:45699] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 14:06:01,852 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 14:06:01,852 DEBUG [RS:1;jenkins-hbase4:39735] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 14:06:01,852 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 14:06:01,852 INFO [RS:1;jenkins-hbase4:39735] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 14:06:01,852 DEBUG [RS:0;jenkins-hbase4:45383] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:01,853 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45383,1690034759616' 2023-07-22 14:06:01,853 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:01,853 INFO [RS:1;jenkins-hbase4:39735] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 14:06:01,854 DEBUG [RS:0;jenkins-hbase4:45383] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:01,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:01,855 DEBUG [RS:0;jenkins-hbase4:45383] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 14:06:01,855 INFO [RS:0;jenkins-hbase4:45383] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 14:06:01,855 INFO [RS:0;jenkins-hbase4:45383] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 14:06:01,967 INFO [RS:1;jenkins-hbase4:39735] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39735%2C1690034759682, suffix=, logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,39735,1690034759682, archiveDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs, maxLogs=32 2023-07-22 14:06:01,969 INFO [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45383%2C1690034759616, suffix=, logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45383,1690034759616, archiveDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs, maxLogs=32 2023-07-22 14:06:01,968 INFO [RS:2;jenkins-hbase4:45699] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45699%2C1690034759741, suffix=, logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45699,1690034759741, archiveDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs, maxLogs=32 2023-07-22 14:06:02,017 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK] 2023-07-22 14:06:02,017 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK] 2023-07-22 14:06:02,019 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK] 2023-07-22 14:06:02,028 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK] 2023-07-22 14:06:02,029 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK] 2023-07-22 14:06:02,029 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK] 2023-07-22 14:06:02,040 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK] 2023-07-22 14:06:02,040 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK] 2023-07-22 14:06:02,041 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK] 2023-07-22 14:06:02,084 INFO [RS:1;jenkins-hbase4:39735] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,39735,1690034759682/jenkins-hbase4.apache.org%2C39735%2C1690034759682.1690034761972 2023-07-22 14:06:02,084 INFO [RS:2;jenkins-hbase4:45699] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45699,1690034759741/jenkins-hbase4.apache.org%2C45699%2C1690034759741.1690034761978 2023-07-22 14:06:02,090 DEBUG [RS:1;jenkins-hbase4:39735] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK], DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK], DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK]] 2023-07-22 14:06:02,098 DEBUG [RS:2;jenkins-hbase4:45699] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK], DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK]] 2023-07-22 14:06:02,100 INFO [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45383,1690034759616/jenkins-hbase4.apache.org%2C45383%2C1690034759616.1690034761971 2023-07-22 14:06:02,103 DEBUG [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK], DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK]] 2023-07-22 14:06:02,120 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:02,128 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:06:02,133 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:06:02,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 14:06:02,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 14:06:02,157 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45383%2C1690034759616.meta, suffix=.meta, logDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45383,1690034759616, archiveDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs, maxLogs=32 2023-07-22 14:06:02,183 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK] 2023-07-22 14:06:02,191 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK] 2023-07-22 14:06:02,195 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK] 2023-07-22 14:06:02,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/WALs/jenkins-hbase4.apache.org,45383,1690034759616/jenkins-hbase4.apache.org%2C45383%2C1690034759616.meta.1690034762159.meta 2023-07-22 14:06:02,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39855,DS-6cef08ed-424a-4f78-a611-9a44dac3fa8d,DISK], DatanodeInfoWithStorage[127.0.0.1:45107,DS-27ab789a-8991-4e22-aa88-b67029b31f96,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-c7022bae-ae81-46c2-84f5-c47090d9ab37,DISK]] 2023-07-22 14:06:02,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 14:06:02,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 14:06:02,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:02,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 14:06:02,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 14:06:02,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 14:06:02,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 14:06:02,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:02,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 14:06:02,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 14:06:02,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 14:06:02,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/info 2023-07-22 14:06:02,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/info 2023-07-22 14:06:02,269 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 14:06:02,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:02,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 14:06:02,271 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/rep_barrier 2023-07-22 14:06:02,271 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/rep_barrier 2023-07-22 14:06:02,274 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 14:06:02,275 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:02,275 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 14:06:02,277 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/table 2023-07-22 14:06:02,277 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/table 2023-07-22 14:06:02,278 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 14:06:02,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:02,281 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740 2023-07-22 14:06:02,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740 2023-07-22 14:06:02,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 14:06:02,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 14:06:02,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61042137, jitterRate=-0.09040127694606781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 14:06:02,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 14:06:02,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690034762106 2023-07-22 14:06:02,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 14:06:02,338 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 14:06:02,343 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45383,1690034759616, state=OPEN 2023-07-22 14:06:02,347 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 14:06:02,347 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 14:06:02,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 14:06:02,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45383,1690034759616 in 493 msec 2023-07-22 14:06:02,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 14:06:02,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 762 msec 2023-07-22 14:06:02,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1630 sec 2023-07-22 14:06:02,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690034762368, completionTime=-1 2023-07-22 14:06:02,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 14:06:02,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 14:06:02,483 DEBUG [hconnection-0x6cd4a75-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:02,486 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:02,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 14:06:02,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690034822515 2023-07-22 14:06:02,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690034882515 2023-07-22 14:06:02,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 146 msec 2023-07-22 14:06:02,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1690034758169-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:02,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1690034758169-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:02,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1690034758169-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:02,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36585, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:02,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 14:06:02,590 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 14:06:02,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 14:06:02,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:02,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 14:06:02,616 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:06:02,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:06:02,653 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:02,656 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757 empty. 2023-07-22 14:06:02,656 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:02,657 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 14:06:02,715 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:02,717 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0926df7e0d7da1cb6ca8ae31f987e757, NAME => 'hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0926df7e0d7da1cb6ca8ae31f987e757, disabling compactions & flushes 2023-07-22 14:06:02,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. after waiting 0 ms 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:02,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:02,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0926df7e0d7da1cb6ca8ae31f987e757: 2023-07-22 14:06:02,751 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:06:02,770 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690034762755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034762755"}]},"ts":"1690034762755"} 2023-07-22 14:06:02,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 14:06:02,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:06:02,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034762802"}]},"ts":"1690034762802"} 2023-07-22 14:06:02,817 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 14:06:02,823 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:02,824 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:02,825 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:02,825 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:02,825 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:02,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0926df7e0d7da1cb6ca8ae31f987e757, ASSIGN}] 2023-07-22 14:06:02,832 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0926df7e0d7da1cb6ca8ae31f987e757, ASSIGN 2023-07-22 14:06:02,834 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0926df7e0d7da1cb6ca8ae31f987e757, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45383,1690034759616; forceNewPlan=false, retain=false 2023-07-22 14:06:02,986 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 14:06:02,987 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0926df7e0d7da1cb6ca8ae31f987e757, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:02,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690034762987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034762987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034762987"}]},"ts":"1690034762987"} 2023-07-22 14:06:02,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0926df7e0d7da1cb6ca8ae31f987e757, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:03,151 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:03,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0926df7e0d7da1cb6ca8ae31f987e757, NAME => 'hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.', STARTKEY => '', ENDKEY => ''} 2023-07-22 14:06:03,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. service=AccessControlService 2023-07-22 14:06:03,153 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:03,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:03,154 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,154 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,156 INFO [StoreOpener-0926df7e0d7da1cb6ca8ae31f987e757-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,158 DEBUG [StoreOpener-0926df7e0d7da1cb6ca8ae31f987e757-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/info 2023-07-22 14:06:03,158 DEBUG [StoreOpener-0926df7e0d7da1cb6ca8ae31f987e757-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/info 2023-07-22 14:06:03,159 INFO [StoreOpener-0926df7e0d7da1cb6ca8ae31f987e757-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0926df7e0d7da1cb6ca8ae31f987e757 columnFamilyName info 2023-07-22 14:06:03,160 INFO [StoreOpener-0926df7e0d7da1cb6ca8ae31f987e757-1] regionserver.HStore(310): Store=0926df7e0d7da1cb6ca8ae31f987e757/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:03,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,167 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:06:03,170 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:03,171 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0926df7e0d7da1cb6ca8ae31f987e757; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68211018, jitterRate=0.01642337441444397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:03,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0926df7e0d7da1cb6ca8ae31f987e757: 2023-07-22 14:06:03,175 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757., pid=6, masterSystemTime=1690034763145 2023-07-22 14:06:03,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:03,178 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:06:03,180 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0926df7e0d7da1cb6ca8ae31f987e757, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:03,180 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690034763179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034763179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034763179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034763179"}]},"ts":"1690034763179"} 2023-07-22 14:06:03,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 14:06:03,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0926df7e0d7da1cb6ca8ae31f987e757, server=jenkins-hbase4.apache.org,45383,1690034759616 in 193 msec 2023-07-22 14:06:03,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 14:06:03,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0926df7e0d7da1cb6ca8ae31f987e757, ASSIGN in 360 msec 2023-07-22 14:06:03,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:06:03,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034763193"}]},"ts":"1690034763193"} 2023-07-22 14:06:03,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 14:06:03,199 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:06:03,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 599 msec 2023-07-22 14:06:03,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 14:06:03,221 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 14:06:03,221 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:03,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 14:06:03,285 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 14:06:03,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-22 14:06:03,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 14:06:03,318 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 14:06:03,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-22 14:06:03,339 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 14:06:03,342 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 14:06:03,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.505sec 2023-07-22 14:06:03,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 14:06:03,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 14:06:03,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 14:06:03,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1690034758169-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 14:06:03,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36585,1690034758169-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 14:06:03,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:03,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 14:06:03,378 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:06:03,380 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:06:03,383 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/acl/3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,383 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/acl/3141443fed49e1c869b14de48c060609 empty. 2023-07-22 14:06:03,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 14:06:03,386 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/acl/3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 14:06:03,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 14:06:03,406 DEBUG [Listener at localhost/44727] zookeeper.ReadOnlyZKClient(139): Connect 0x33146fc9 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:03,419 DEBUG [Listener at localhost/44727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9eca1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:03,433 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:03,443 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3141443fed49e1c869b14de48c060609, NAME => 'hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:03,445 DEBUG [hconnection-0x72776d24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:03,463 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:03,470 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:06:03,470 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 14:06:03,470 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/test.cache.data in system properties and HBase conf 2023-07-22 14:06:03,470 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop.log.dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 14:06:03,471 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/nfs.dump.dir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 14:06:03,472 INFO [Listener at localhost/44727] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 14:06:03,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 3141443fed49e1c869b14de48c060609, disabling compactions & flushes 2023-07-22 14:06:03,500 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. after waiting 0 ms 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,500 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,500 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 3141443fed49e1c869b14de48c060609: 2023-07-22 14:06:03,506 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:06:03,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690034763507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034763507"}]},"ts":"1690034763507"} 2023-07-22 14:06:03,512 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 14:06:03,513 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:06:03,514 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034763513"}]},"ts":"1690034763513"} 2023-07-22 14:06:03,520 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 14:06:03,527 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:03,528 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:03,528 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:03,528 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:03,528 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:03,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3141443fed49e1c869b14de48c060609, ASSIGN}] 2023-07-22 14:06:03,532 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3141443fed49e1c869b14de48c060609, ASSIGN 2023-07-22 14:06:03,536 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=3141443fed49e1c869b14de48c060609, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:06:03,686 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 14:06:03,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3141443fed49e1c869b14de48c060609, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:03,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690034763687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034763687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034763687"}]},"ts":"1690034763687"} 2023-07-22 14:06:03,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3141443fed49e1c869b14de48c060609, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:06:03,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 14:06:03,852 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:03,853 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:06:03,857 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:06:03,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3141443fed49e1c869b14de48c060609, NAME => 'hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.', STARTKEY => '', ENDKEY => ''} 2023-07-22 14:06:03,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. service=AccessControlService 2023-07-22 14:06:03,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:03,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:03,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,869 INFO [StoreOpener-3141443fed49e1c869b14de48c060609-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,871 DEBUG [StoreOpener-3141443fed49e1c869b14de48c060609-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/l 2023-07-22 14:06:03,871 DEBUG [StoreOpener-3141443fed49e1c869b14de48c060609-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/l 2023-07-22 14:06:03,871 INFO [StoreOpener-3141443fed49e1c869b14de48c060609-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3141443fed49e1c869b14de48c060609 columnFamilyName l 2023-07-22 14:06:03,872 INFO [StoreOpener-3141443fed49e1c869b14de48c060609-1] regionserver.HStore(310): Store=3141443fed49e1c869b14de48c060609/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:03,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,875 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3141443fed49e1c869b14de48c060609 2023-07-22 14:06:03,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:03,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3141443fed49e1c869b14de48c060609; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60145482, jitterRate=-0.10376247763633728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:03,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3141443fed49e1c869b14de48c060609: 2023-07-22 14:06:03,889 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609., pid=11, masterSystemTime=1690034763852 2023-07-22 14:06:03,892 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,893 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:06:03,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3141443fed49e1c869b14de48c060609, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:03,894 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690034763894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034763894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034763894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034763894"}]},"ts":"1690034763894"} 2023-07-22 14:06:03,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 14:06:03,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3141443fed49e1c869b14de48c060609, server=jenkins-hbase4.apache.org,39735,1690034759682 in 201 msec 2023-07-22 14:06:03,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 14:06:03,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=3141443fed49e1c869b14de48c060609, ASSIGN in 373 msec 2023-07-22 14:06:03,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:06:03,911 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034763911"}]},"ts":"1690034763911"} 2023-07-22 14:06:03,915 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 14:06:03,918 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:06:03,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 544 msec 2023-07-22 14:06:03,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 14:06:03,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 14:06:04,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 14:06:04,706 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:06:05,023 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:06:05,030 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41879_jobhistory____q3ny06/webapp 2023-07-22 14:06:05,191 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 14:06:05,191 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 14:06:05,191 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 14:06:05,194 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 14:06:05,272 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:05,548 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:05,865 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 14:06:05,932 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41879 2023-07-22 14:06:06,209 WARN [Listener at jenkins-hbase4.apache.org/41433] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:06:06,639 WARN [Listener at jenkins-hbase4.apache.org/41433] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 14:06:06,640 INFO [Listener at jenkins-hbase4.apache.org/41433] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:06:06,651 INFO [Listener at jenkins-hbase4.apache.org/41433] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36949_cluster____.llh8qf/webapp 2023-07-22 14:06:06,750 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 14:06:06,751 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 14:06:06,751 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 14:06:06,751 INFO [Listener at jenkins-hbase4.apache.org/41433] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 14:06:06,760 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:07,022 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:07,217 INFO [Listener at jenkins-hbase4.apache.org/41433] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:07,228 INFO [Listener at jenkins-hbase4.apache.org/41433] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36949 2023-07-22 14:06:07,887 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:06:07,963 WARN [Listener at jenkins-hbase4.apache.org/36881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:06:07,993 WARN [Listener at jenkins-hbase4.apache.org/36881] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 14:06:07,994 INFO [Listener at jenkins-hbase4.apache.org/36881] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:06:08,004 INFO [Listener at jenkins-hbase4.apache.org/36881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39775_node____.p7a2z7/webapp 2023-07-22 14:06:08,066 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 14:06:08,067 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 14:06:08,068 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 14:06:08,093 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 14:06:08,093 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 14:06:08,093 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 14:06:08,094 INFO [Listener at jenkins-hbase4.apache.org/36881] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 14:06:08,101 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,124 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,230 INFO [Listener at jenkins-hbase4.apache.org/36881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,242 INFO [Listener at jenkins-hbase4.apache.org/36881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39775 2023-07-22 14:06:08,346 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:08,346 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 14:06:08,347 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:08,347 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 14:06:08,347 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 14:06:08,347 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 14:06:08,348 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:08,348 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 14:06:08,348 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 14:06:08,348 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 14:06:08,490 WARN [Listener at jenkins-hbase4.apache.org/35687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 14:06:08,498 WARN [Listener at jenkins-hbase4.apache.org/35687] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 14:06:08,499 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 14:06:08,506 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37561_node____apyadm/webapp 2023-07-22 14:06:08,562 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 14:06:08,563 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 14:06:08,563 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 14:06:08,564 INFO [Listener at jenkins-hbase4.apache.org/35687] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 14:06:08,572 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,584 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,652 INFO [Listener at jenkins-hbase4.apache.org/35687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 14:06:08,659 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37561 2023-07-22 14:06:08,685 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 14:06:08,687 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:08,770 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=177, AvailableMemoryMB=8768 2023-07-22 14:06:08,770 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-22 14:06:08,786 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 14:06:08,793 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 14:06:08,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:08,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:08,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:06:08,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 14:06:08,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 14:06:08,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:06:08,816 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:08,816 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:08,818 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 empty. 2023-07-22 14:06:08,818 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 empty. 2023-07-22 14:06:08,821 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:08,821 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:08,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 14:06:08,849 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:08,851 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f6eae1272a1981e1337dd37d026f3157, NAME => 'testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:08,852 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e4c7508e668bae04c69ca45ee0ae4324, NAME => 'testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:08,910 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:08,910 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e4c7508e668bae04c69ca45ee0ae4324, disabling compactions & flushes 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f6eae1272a1981e1337dd37d026f3157, disabling compactions & flushes 2023-07-22 14:06:08,911 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:08,911 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. after waiting 0 ms 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. after waiting 0 ms 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:08,911 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:08,911 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e4c7508e668bae04c69ca45ee0ae4324: 2023-07-22 14:06:08,911 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f6eae1272a1981e1337dd37d026f3157: 2023-07-22 14:06:08,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 14:06:08,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:06:08,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034768917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034768917"}]},"ts":"1690034768917"} 2023-07-22 14:06:08,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034768917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034768917"}]},"ts":"1690034768917"} 2023-07-22 14:06:08,971 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:06:08,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:06:08,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034768974"}]},"ts":"1690034768974"} 2023-07-22 14:06:08,977 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 14:06:08,983 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:08,986 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:08,986 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:08,986 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:08,986 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:08,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, ASSIGN}] 2023-07-22 14:06:08,990 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, ASSIGN 2023-07-22 14:06:08,991 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, ASSIGN 2023-07-22 14:06:08,993 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45383,1690034759616; forceNewPlan=false, retain=false 2023-07-22 14:06:08,993 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:06:09,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 14:06:09,144 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:06:09,146 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e4c7508e668bae04c69ca45ee0ae4324, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:09,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6eae1272a1981e1337dd37d026f3157, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:09,146 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034769146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034769146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034769146"}]},"ts":"1690034769146"} 2023-07-22 14:06:09,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034769146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034769146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034769146"}]},"ts":"1690034769146"} 2023-07-22 14:06:09,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e4c7508e668bae04c69ca45ee0ae4324, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:06:09,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure f6eae1272a1981e1337dd37d026f3157, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:09,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:09,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:09,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6eae1272a1981e1337dd37d026f3157, NAME => 'testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:06:09,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4c7508e668bae04c69ca45ee0ae4324, NAME => 'testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. service=AccessControlService 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. service=AccessControlService 2023-07-22 14:06:09,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:09,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,315 INFO [StoreOpener-f6eae1272a1981e1337dd37d026f3157-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,315 INFO [StoreOpener-e4c7508e668bae04c69ca45ee0ae4324-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,317 DEBUG [StoreOpener-f6eae1272a1981e1337dd37d026f3157-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf 2023-07-22 14:06:09,317 DEBUG [StoreOpener-f6eae1272a1981e1337dd37d026f3157-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf 2023-07-22 14:06:09,317 DEBUG [StoreOpener-e4c7508e668bae04c69ca45ee0ae4324-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf 2023-07-22 14:06:09,317 DEBUG [StoreOpener-e4c7508e668bae04c69ca45ee0ae4324-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf 2023-07-22 14:06:09,317 INFO [StoreOpener-f6eae1272a1981e1337dd37d026f3157-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6eae1272a1981e1337dd37d026f3157 columnFamilyName cf 2023-07-22 14:06:09,318 INFO [StoreOpener-e4c7508e668bae04c69ca45ee0ae4324-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4c7508e668bae04c69ca45ee0ae4324 columnFamilyName cf 2023-07-22 14:06:09,318 INFO [StoreOpener-e4c7508e668bae04c69ca45ee0ae4324-1] regionserver.HStore(310): Store=e4c7508e668bae04c69ca45ee0ae4324/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:09,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,321 INFO [StoreOpener-f6eae1272a1981e1337dd37d026f3157-1] regionserver.HStore(310): Store=f6eae1272a1981e1337dd37d026f3157/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:09,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:09,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4c7508e668bae04c69ca45ee0ae4324; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72270363, jitterRate=0.07691232860088348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:09,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4c7508e668bae04c69ca45ee0ae4324: 2023-07-22 14:06:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:09,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324., pid=15, masterSystemTime=1690034769303 2023-07-22 14:06:09,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:09,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:09,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:09,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e4c7508e668bae04c69ca45ee0ae4324, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:09,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034769343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034769343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034769343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034769343"}]},"ts":"1690034769343"} 2023-07-22 14:06:09,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f6eae1272a1981e1337dd37d026f3157; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63664216, jitterRate=-0.05132925510406494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:09,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f6eae1272a1981e1337dd37d026f3157: 2023-07-22 14:06:09,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157., pid=16, masterSystemTime=1690034769304 2023-07-22 14:06:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:09,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:09,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6eae1272a1981e1337dd37d026f3157, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:09,356 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034769355"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034769355"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034769355"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034769355"}]},"ts":"1690034769355"} 2023-07-22 14:06:09,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-22 14:06:09,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e4c7508e668bae04c69ca45ee0ae4324, server=jenkins-hbase4.apache.org,39735,1690034759682 in 197 msec 2023-07-22 14:06:09,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, ASSIGN in 371 msec 2023-07-22 14:06:09,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-22 14:06:09,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure f6eae1272a1981e1337dd37d026f3157, server=jenkins-hbase4.apache.org,45383,1690034759616 in 208 msec 2023-07-22 14:06:09,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-22 14:06:09,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, ASSIGN in 379 msec 2023-07-22 14:06:09,369 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:06:09,369 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034769369"}]},"ts":"1690034769369"} 2023-07-22 14:06:09,371 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 14:06:09,374 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:06:09,379 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 14:06:09,386 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:09,390 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:09,393 DEBUG [hconnection-0x521a2523-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:09,396 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-22 14:06:09,411 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 14:06:09,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 14:06:09,466 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,466 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,466 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,467 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,467 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:06:09,481 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,481 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,481 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:09,488 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:09,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:09,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:09,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 689 msec 2023-07-22 14:06:09,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 14:06:09,918 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 14:06:09,918 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-22 14:06:09,919 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:09,923 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-22 14:06:09,924 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:09,924 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-22 14:06:09,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034769938 (current time:1690034769938). 2023-07-22 14:06:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x53d7dcc7 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15074060, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:09,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:09,948 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d7dcc7 to 127.0.0.1:59777 2023-07-22 14:06:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:09,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x400825ce to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:09,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bed730d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:09,957 DEBUG [hconnection-0x355e4078-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:09,958 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:09,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:09,964 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x400825ce to 127.0.0.1:59777 2023-07-22 14:06:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 14:06:09,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:09,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:10,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,013 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,015 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690035370015 2023-07-22 14:06:10,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:10,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 14:06:10,021 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:10,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 20 msec 2023-07-22 14:06:10,024 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:10,024 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:10,025 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:10,025 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690035370025 2023-07-22 14:06:10,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,062 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 14:06:10,063 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,063 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 14:06:10,064 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 14:06:10,064 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,064 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,071 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:10,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,074 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 14:06:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,078 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,079 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,079 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,078 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,083 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,083 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,084 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,084 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,084 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,082 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,084 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,087 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,087 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,091 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 14:06:10,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575f0468[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 14:06:10,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575f0468[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:10,099 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 14:06:10,099 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:10,105 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:10,105 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:10,105 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:10,105 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:10,105 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:10,106 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:10,106 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:10,108 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. started... 2023-07-22 14:06:10,108 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,108 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:10,109 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. started... 2023-07-22 14:06:10,112 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4c7508e668bae04c69ca45ee0ae4324: 2023-07-22 14:06:10,112 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6eae1272a1981e1337dd37d026f3157: 2023-07-22 14:06:10,113 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,113 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,118 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:10,118 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:10,123 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:10,123 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:10,125 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:10,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:10,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:10,132 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:10,150 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. completed. 2023-07-22 14:06:10,151 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:10,155 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. completed. 2023-07-22 14:06:10,155 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:10,156 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,158 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:06:10,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 14:06:10,168 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 14:06:10,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:10,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:10,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,168 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,172 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,172 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,173 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,175 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,175 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,176 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,189 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,189 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,188 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,190 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,190 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,190 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,190 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 14:06:10,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,321 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:10,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690034770015Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690034770190 (+175 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690034770190Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690034770209 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690034770228 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690034770320 (+92 ms) 2023-07-22 14:06:10,323 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:10,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 306 msec 2023-07-22 14:06:10,332 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:10,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:10,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:10,357 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:10,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45383] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:10,364 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:10,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39735] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:10,374 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 14:06:10,375 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:10,378 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:10,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034770411 (current time:1690034770411). 2023-07-22 14:06:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x785b1a75 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:10,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d24e6ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:10,431 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785b1a75 to 127.0.0.1:59777 2023-07-22 14:06:10,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:10,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x12c1388a to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:10,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32690015, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:10,442 DEBUG [hconnection-0x5892a94d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:10,445 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:10,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:10,456 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:10,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12c1388a to 127.0.0.1:59777 2023-07-22 14:06:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 14:06:10,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:10,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:10,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,468 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,469 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690035370469 2023-07-22 14:06:10,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 14:06:10,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 14:06:10,471 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:10,471 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:10,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:10,473 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 14:06:10,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-22 14:06:10,476 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:10,477 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690035370477 2023-07-22 14:06:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:10,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:10,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:10,774 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:10,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:10,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:10,776 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 14:06:10,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 14:06:10,911 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 14:06:10,911 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,911 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 14:06:10,912 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 14:06:10,912 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,912 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,914 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,914 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,914 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:10,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,915 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,915 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,916 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,916 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 14:06:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,917 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 14:06:10,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 14:06:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 14:06:10,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 14:06:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,924 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 14:06:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,933 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,934 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 14:06:10,934 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 14:06:10,934 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 14:06:10,941 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,943 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,943 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,943 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 14:06:10,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d2b3b94[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:10,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:10,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:10,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:10,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 14:06:10,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d2b3b94[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:10,950 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 14:06:10,950 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,955 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 14:06:10,955 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:10,955 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:10,955 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:10,955 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. started... 2023-07-22 14:06:10,955 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:10,956 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4c7508e668bae04c69ca45ee0ae4324 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 14:06:10,956 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:10,956 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:10,956 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:10,956 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. started... 2023-07-22 14:06:10,956 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f6eae1272a1981e1337dd37d026f3157 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 14:06:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:10,958 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:11,075 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/.tmp/cf/bddedbd0122a43e4a6d4a2c1b5d7efab 2023-07-22 14:06:11,076 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:11,077 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/.tmp/cf/c894cb7a7e8240a4a55da21c890b3168 2023-07-22 14:06:11,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:11,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:11,078 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 14:06:11,136 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/.tmp/cf/bddedbd0122a43e4a6d4a2c1b5d7efab as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab 2023-07-22 14:06:11,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/.tmp/cf/c894cb7a7e8240a4a55da21c890b3168 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168 2023-07-22 14:06:11,150 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 14:06:11,153 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f6eae1272a1981e1337dd37d026f3157 in 197ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:11,153 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 14:06:11,153 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab, entries=47, sequenceid=6, filesize=8 K 2023-07-22 14:06:11,157 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e4c7508e668bae04c69ca45ee0ae4324 in 201ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:11,157 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 14:06:11,163 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6eae1272a1981e1337dd37d026f3157: 2023-07-22 14:06:11,163 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4c7508e668bae04c69ca45ee0ae4324: 2023-07-22 14:06:11,164 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 14:06:11,164 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:11,164 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab] hfiles 2023-07-22 14:06:11,164 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab for snapshot=snaptb0-testExportWithTargetName 2023-07-22 14:06:11,166 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 14:06:11,166 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:11,166 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168] hfiles 2023-07-22 14:06:11,166 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 14:06:11,210 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. completed. 2023-07-22 14:06:11,210 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:11,210 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:11,210 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:11,210 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,210 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:11,210 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:11,214 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:11,214 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:11,214 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:11,214 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:11,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:11,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:11,217 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. completed. 2023-07-22 14:06:11,217 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:11,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 14:06:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,219 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,219 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 14:06:11,220 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:11,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,220 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 14:06:11,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:11,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:11,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:06:11,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 14:06:11,231 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 14:06:11,231 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:11,231 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:11,231 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 14:06:11,231 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:11,238 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,239 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,240 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:11,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,240 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,241 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,243 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,243 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,248 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:11,248 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 14:06:11,249 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,278 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:11,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:11,279 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:11,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 14:06:11,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:11,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:11,279 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:11,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:11,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,281 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:11,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:11,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 14:06:11,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 14:06:11,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690034770469Consolidate snapshot: snaptb0-testExportWithTargetName at 1690034771279 (+810 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690034771280 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690034771296 (+16 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690034771331 (+35 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690034771392 (+61 ms) 2023-07-22 14:06:11,394 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 14:06:11,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 923 msec 2023-07-22 14:06:11,578 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:11,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 14:06:11,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:11,582 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582 2023-07-22 14:06:11,582 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42431, tgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582, rawTgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:11,636 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:11,636 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1633156130_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 14:06:11,636 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 14:06:11,665 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 14:06:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,856 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,856 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,856 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,857 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,857 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,954 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-452965278622771649.jar 2023-07-22 14:06:11,954 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,955 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,956 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,957 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,957 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:11,958 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:06:11,959 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:06:11,959 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:06:11,960 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:06:11,961 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:06:11,962 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:06:11,962 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:06:11,963 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:06:11,964 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:06:11,964 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:06:11,968 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:11,969 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:11,969 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:11,970 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:11,970 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:11,971 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:11,971 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:12,841 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:06:12,848 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 14:06:12,859 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 14:06:13,305 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:13,307 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:13,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0001_000001 (auth:SIMPLE) 2023-07-22 14:06:14,823 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:06:19,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0001_000001 (auth:SIMPLE) 2023-07-22 14:06:21,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0001_000001 (auth:SIMPLE) 2023-07-22 14:06:25,356 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0001_000001 (auth:SIMPLE) 2023-07-22 14:06:26,789 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:06:26,794 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:06:26,803 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 14:06:26,803 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:06:26,804 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:06:26,804 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 14:06:26,805 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 14:06:26,805 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 14:06:26,805 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/testExportWithTargetName 2023-07-22 14:06:26,805 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 14:06:26,806 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034771582/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 14:06:26,818 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 14:06:26,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 14:06:26,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:26,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034786836"}]},"ts":"1690034786836"} 2023-07-22 14:06:26,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 14:06:26,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 14:06:26,840 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 14:06:26,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, UNASSIGN}] 2023-07-22 14:06:26,844 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, UNASSIGN 2023-07-22 14:06:26,844 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, UNASSIGN 2023-07-22 14:06:26,845 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e4c7508e668bae04c69ca45ee0ae4324, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:26,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f6eae1272a1981e1337dd37d026f3157, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:26,845 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034786845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034786845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034786845"}]},"ts":"1690034786845"} 2023-07-22 14:06:26,845 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034786845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034786845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034786845"}]},"ts":"1690034786845"} 2023-07-22 14:06:26,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e4c7508e668bae04c69ca45ee0ae4324, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:06:26,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure f6eae1272a1981e1337dd37d026f3157, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 14:06:27,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:27,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f6eae1272a1981e1337dd37d026f3157, disabling compactions & flushes 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4c7508e668bae04c69ca45ee0ae4324, disabling compactions & flushes 2023-07-22 14:06:27,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:27,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. after waiting 0 ms 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. after waiting 0 ms 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:27,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:27,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:06:27,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:06:27,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:27,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:27,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324. 2023-07-22 14:06:27,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157. 2023-07-22 14:06:27,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4c7508e668bae04c69ca45ee0ae4324: 2023-07-22 14:06:27,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f6eae1272a1981e1337dd37d026f3157: 2023-07-22 14:06:27,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:27,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f6eae1272a1981e1337dd37d026f3157, regionState=CLOSED 2023-07-22 14:06:27,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034787032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034787032"}]},"ts":"1690034787032"} 2023-07-22 14:06:27,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:27,033 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e4c7508e668bae04c69ca45ee0ae4324, regionState=CLOSED 2023-07-22 14:06:27,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690034787033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034787033"}]},"ts":"1690034787033"} 2023-07-22 14:06:27,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-22 14:06:27,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure f6eae1272a1981e1337dd37d026f3157, server=jenkins-hbase4.apache.org,45383,1690034759616 in 185 msec 2023-07-22 14:06:27,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-22 14:06:27,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e4c7508e668bae04c69ca45ee0ae4324, server=jenkins-hbase4.apache.org,39735,1690034759682 in 189 msec 2023-07-22 14:06:27,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4c7508e668bae04c69ca45ee0ae4324, UNASSIGN in 196 msec 2023-07-22 14:06:27,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-22 14:06:27,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6eae1272a1981e1337dd37d026f3157, UNASSIGN in 195 msec 2023-07-22 14:06:27,044 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034787044"}]},"ts":"1690034787044"} 2023-07-22 14:06:27,045 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 14:06:27,047 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 14:06:27,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-07-22 14:06:27,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 14:06:27,140 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 14:06:27,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 14:06:27,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,156 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 14:06:27,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,162 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 14:06:27,165 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:27,165 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:27,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 14:06:27,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 14:06:27,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 14:06:27,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 14:06:27,168 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,168 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,168 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,169 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,169 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/recovered.edits] 2023-07-22 14:06:27,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 14:06:27,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 14:06:27,169 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:06:27,169 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/recovered.edits] 2023-07-22 14:06:27,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 14:06:27,169 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:06:27,169 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:06:27,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 14:06:27,170 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:06:27,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 14:06:27,177 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/cf/bddedbd0122a43e4a6d4a2c1b5d7efab 2023-07-22 14:06:27,177 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/cf/c894cb7a7e8240a4a55da21c890b3168 2023-07-22 14:06:27,181 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324/recovered.edits/9.seqid 2023-07-22 14:06:27,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157/recovered.edits/9.seqid 2023-07-22 14:06:27,182 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/e4c7508e668bae04c69ca45ee0ae4324 2023-07-22 14:06:27,182 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportWithTargetName/f6eae1272a1981e1337dd37d026f3157 2023-07-22 14:06:27,182 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 14:06:27,185 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,205 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 14:06:27,208 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 14:06:27,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 14:06:27,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034787209"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:27,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034787209"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:27,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:06:27,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f6eae1272a1981e1337dd37d026f3157, NAME => 'testtb-testExportWithTargetName,,1690034768799.f6eae1272a1981e1337dd37d026f3157.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e4c7508e668bae04c69ca45ee0ae4324, NAME => 'testtb-testExportWithTargetName,1,1690034768799.e4c7508e668bae04c69ca45ee0ae4324.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:06:27,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 14:06:27,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034787212"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:27,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 14:06:27,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 14:06:27,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 69 msec 2023-07-22 14:06:27,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 14:06:27,273 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 14:06:27,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 14:06:27,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 14:06:27,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 14:06:27,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 14:06:27,337 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 709) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:60514 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:39627 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:35074 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1535131612_1 at /127.0.0.1:47386 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:35687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:34433 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=350 (was 179) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=6771 (was 8768) 2023-07-22 14:06:27,337 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-22 14:06:27,362 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=350, ProcessCount=183, AvailableMemoryMB=6771 2023-07-22 14:06:27,362 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-22 14:06:27,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:27,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:27,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:06:27,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 14:06:27,370 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:06:27,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 14:06:27,374 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,374 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,375 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 empty. 2023-07-22 14:06:27,375 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 empty. 2023-07-22 14:06:27,376 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,376 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,376 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 14:06:27,390 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:27,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5c1570c65224f4d4a29a3b8fe97fd535, NAME => 'testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:27,393 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e0cf2d6eab806f25bcdf342d2db05b55, NAME => 'testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:27,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:27,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5c1570c65224f4d4a29a3b8fe97fd535, disabling compactions & flushes 2023-07-22 14:06:27,414 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. after waiting 0 ms 2023-07-22 14:06:27,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,414 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5c1570c65224f4d4a29a3b8fe97fd535: 2023-07-22 14:06:27,417 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:27,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e0cf2d6eab806f25bcdf342d2db05b55, disabling compactions & flushes 2023-07-22 14:06:27,418 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. after waiting 0 ms 2023-07-22 14:06:27,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,418 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e0cf2d6eab806f25bcdf342d2db05b55: 2023-07-22 14:06:27,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:06:27,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034787422"}]},"ts":"1690034787422"} 2023-07-22 14:06:27,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034787422"}]},"ts":"1690034787422"} 2023-07-22 14:06:27,425 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:06:27,426 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:06:27,426 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034787426"}]},"ts":"1690034787426"} 2023-07-22 14:06:27,428 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 14:06:27,431 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:27,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:27,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:27,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:27,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:27,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, ASSIGN}] 2023-07-22 14:06:27,435 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, ASSIGN 2023-07-22 14:06:27,435 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, ASSIGN 2023-07-22 14:06:27,436 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:06:27,436 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45383,1690034759616; forceNewPlan=false, retain=false 2023-07-22 14:06:27,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 14:06:27,586 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:06:27,589 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c1570c65224f4d4a29a3b8fe97fd535, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:27,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e0cf2d6eab806f25bcdf342d2db05b55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:27,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034787589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034787589"}]},"ts":"1690034787589"} 2023-07-22 14:06:27,589 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034787589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034787589"}]},"ts":"1690034787589"} 2023-07-22 14:06:27,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e0cf2d6eab806f25bcdf342d2db05b55, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:06:27,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 5c1570c65224f4d4a29a3b8fe97fd535, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:27,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 14:06:27,746 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:27,746 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:06:27,750 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:06:27,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c1570c65224f4d4a29a3b8fe97fd535, NAME => 'testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:06:27,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. service=AccessControlService 2023-07-22 14:06:27,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:27,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:27,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,757 INFO [StoreOpener-5c1570c65224f4d4a29a3b8fe97fd535-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0cf2d6eab806f25bcdf342d2db05b55, NAME => 'testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:06:27,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. service=AccessControlService 2023-07-22 14:06:27,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:27,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:27,759 DEBUG [StoreOpener-5c1570c65224f4d4a29a3b8fe97fd535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf 2023-07-22 14:06:27,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,759 DEBUG [StoreOpener-5c1570c65224f4d4a29a3b8fe97fd535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf 2023-07-22 14:06:27,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,760 INFO [StoreOpener-5c1570c65224f4d4a29a3b8fe97fd535-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c1570c65224f4d4a29a3b8fe97fd535 columnFamilyName cf 2023-07-22 14:06:27,760 INFO [StoreOpener-5c1570c65224f4d4a29a3b8fe97fd535-1] regionserver.HStore(310): Store=5c1570c65224f4d4a29a3b8fe97fd535/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:27,761 INFO [StoreOpener-e0cf2d6eab806f25bcdf342d2db05b55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,764 DEBUG [StoreOpener-e0cf2d6eab806f25bcdf342d2db05b55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf 2023-07-22 14:06:27,764 DEBUG [StoreOpener-e0cf2d6eab806f25bcdf342d2db05b55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf 2023-07-22 14:06:27,764 INFO [StoreOpener-e0cf2d6eab806f25bcdf342d2db05b55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0cf2d6eab806f25bcdf342d2db05b55 columnFamilyName cf 2023-07-22 14:06:27,765 INFO [StoreOpener-e0cf2d6eab806f25bcdf342d2db05b55-1] regionserver.HStore(310): Store=e0cf2d6eab806f25bcdf342d2db05b55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:27,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:27,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:27,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5c1570c65224f4d4a29a3b8fe97fd535; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75306976, jitterRate=0.1221613883972168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:27,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5c1570c65224f4d4a29a3b8fe97fd535: 2023-07-22 14:06:27,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:27,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535., pid=31, masterSystemTime=1690034787746 2023-07-22 14:06:27,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:27,777 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c1570c65224f4d4a29a3b8fe97fd535, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:27,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787777"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034787777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034787777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034787777"}]},"ts":"1690034787777"} 2023-07-22 14:06:27,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:27,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0cf2d6eab806f25bcdf342d2db05b55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64981408, jitterRate=-0.03170156478881836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:27,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0cf2d6eab806f25bcdf342d2db05b55: 2023-07-22 14:06:27,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55., pid=30, masterSystemTime=1690034787746 2023-07-22 14:06:27,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:27,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-22 14:06:27,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e0cf2d6eab806f25bcdf342d2db05b55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:27,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 5c1570c65224f4d4a29a3b8fe97fd535, server=jenkins-hbase4.apache.org,45383,1690034759616 in 187 msec 2023-07-22 14:06:27,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034787786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034787786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034787786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034787786"}]},"ts":"1690034787786"} 2023-07-22 14:06:27,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, ASSIGN in 354 msec 2023-07-22 14:06:27,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-22 14:06:27,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e0cf2d6eab806f25bcdf342d2db05b55, server=jenkins-hbase4.apache.org,45699,1690034759741 in 197 msec 2023-07-22 14:06:27,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-22 14:06:27,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, ASSIGN in 361 msec 2023-07-22 14:06:27,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:06:27,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034787799"}]},"ts":"1690034787799"} 2023-07-22 14:06:27,801 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 14:06:27,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:06:27,806 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 14:06:27,808 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:06:27,811 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,811 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,811 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,811 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:27,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:27,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:27,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:27,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:27,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 450 msec 2023-07-22 14:06:27,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 14:06:27,975 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 14:06:27,975 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 14:06:27,975 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:27,979 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 14:06:27,979 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:27,979 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-22 14:06:27,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:27,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034787984 (current time:1690034787984). 2023-07-22 14:06:27,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:27,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x08da5cb7 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:27,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27157d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:27,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:27,994 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:27,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08da5cb7 to 127.0.0.1:59777 2023-07-22 14:06:27,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:27,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x07716c8a to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:28,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d94b737, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:28,006 DEBUG [hconnection-0x51641dee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,009 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,014 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07716c8a to 127.0.0.1:59777 2023-07-22 14:06:28,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:28,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:06:28,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:28,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:28,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,020 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,021 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690035388021 2023-07-22 14:06:28,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 14:06:28,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:28,023 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:28,023 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:28,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,025 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-22 14:06:28,028 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,029 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690035388029 2023-07-22 14:06:28,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,042 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 14:06:28,042 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,043 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 14:06:28,043 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 14:06:28,047 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,047 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,049 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,049 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,049 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,050 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,050 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,051 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,051 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,059 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,062 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,062 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,062 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,063 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,064 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,073 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,074 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,074 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,074 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,074 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,074 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,074 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,075 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,075 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5641d78b[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 14:06:28,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5641d78b[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:28,081 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 14:06:28,081 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,082 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,082 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:28,083 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:28,082 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,083 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:28,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. started... 2023-07-22 14:06:28,083 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. started... 2023-07-22 14:06:28,085 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0cf2d6eab806f25bcdf342d2db05b55: 2023-07-22 14:06:28,085 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5c1570c65224f4d4a29a3b8fe97fd535: 2023-07-22 14:06:28,085 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,085 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:28,085 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,086 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,086 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:28,086 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:28,086 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:28,086 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:28,089 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,089 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,090 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,112 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. completed. 2023-07-22 14:06:28,113 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:28,113 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. completed. 2023-07-22 14:06:28,113 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,113 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:28,115 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,115 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,115 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,115 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,117 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,117 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,117 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,123 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:06:28,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:28,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,125 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:06:28,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 14:06:28,133 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 14:06:28,133 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:28,133 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:28,133 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,133 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,137 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,137 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,138 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,140 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,140 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,141 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,148 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,150 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,148 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,150 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,150 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,150 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,150 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,151 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,151 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,151 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 14:06:28,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,196 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:28,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690034788021Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690034788151 (+130 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690034788151Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690034788156 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690034788166 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690034788195 (+29 ms) 2023-07-22 14:06:28,199 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 176 msec 2023-07-22 14:06:28,325 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:28,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:06:28,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:28,336 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45383] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:28,342 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:28,353 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 14:06:28,353 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:28,353 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:28,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:28,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034788372 (current time:1690034788372). 2023-07-22 14:06:28,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:28,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x4315e4d5 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:28,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d98018f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:28,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,384 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4315e4d5 to 127.0.0.1:59777 2023-07-22 14:06:28,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:28,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x4cc74f58 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:28,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d51c0ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:28,399 DEBUG [hconnection-0x69e58ba5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,400 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:28,408 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:28,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cc74f58 to 127.0.0.1:59777 2023-07-22 14:06:28,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:28,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:06:28,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:28,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:28,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,415 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,417 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690035388417 2023-07-22 14:06:28,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 14:06:28,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:06:28,417 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:28,419 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:28,420 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:06:28,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-22 14:06:28,423 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,424 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690035388424 2023-07-22 14:06:28,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 14:06:28,449 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 14:06:28,449 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,450 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 14:06:28,450 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 14:06:28,451 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,451 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,453 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,453 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,453 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,454 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,454 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,454 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,454 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 14:06:28,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,454 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 14:06:28,455 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,455 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 14:06:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,458 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,458 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,458 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,460 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 14:06:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,461 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 14:06:28,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 14:06:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 14:06:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,465 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,465 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 14:06:28,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2242b14c[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 14:06:28,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2242b14c[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:28,471 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 14:06:28,472 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:28,474 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:28,474 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. started... 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,474 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:28,474 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0cf2d6eab806f25bcdf342d2db05b55 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 14:06:28,474 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. started... 2023-07-22 14:06:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:28,477 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5c1570c65224f4d4a29a3b8fe97fd535 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 14:06:28,477 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,481 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,481 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,499 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/.tmp/cf/0268328144bb49d98ea5674a71b1e519 2023-07-22 14:06:28,505 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/.tmp/cf/2d5ee7bb0b60499c99637610341603c0 2023-07-22 14:06:28,512 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/.tmp/cf/0268328144bb49d98ea5674a71b1e519 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519 2023-07-22 14:06:28,519 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:28,519 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/.tmp/cf/2d5ee7bb0b60499c99637610341603c0 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0 2023-07-22 14:06:28,521 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519, entries=5, sequenceid=6, filesize=5.2 K 2023-07-22 14:06:28,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:06:28,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:28,523 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:28,527 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5c1570c65224f4d4a29a3b8fe97fd535 in 50ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:28,527 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 14:06:28,528 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0, entries=45, sequenceid=6, filesize=7.9 K 2023-07-22 14:06:28,528 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5c1570c65224f4d4a29a3b8fe97fd535: 2023-07-22 14:06:28,528 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 14:06:28,528 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:28,528 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519] hfiles 2023-07-22 14:06:28,528 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 14:06:28,529 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e0cf2d6eab806f25bcdf342d2db05b55 in 55ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:28,530 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0cf2d6eab806f25bcdf342d2db05b55: 2023-07-22 14:06:28,530 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 14:06:28,531 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:28,531 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0] hfiles 2023-07-22 14:06:28,531 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 14:06:28,574 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. completed. 2023-07-22 14:06:28,574 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:28,574 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. completed. 2023-07-22 14:06:28,574 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:28,574 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 14:06:28,575 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:28,581 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,581 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,581 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,581 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,583 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 14:06:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 14:06:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:06:28,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 14:06:28,593 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 14:06:28,593 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:28,593 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:28,593 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 14:06:28,593 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:28,595 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,595 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,595 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,596 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,595 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:28,596 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,597 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,601 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,602 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:28,607 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 14:06:28,607 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,607 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:28,615 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:28,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 14:06:28,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 14:06:28,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,615 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:28,617 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,617 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,617 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,617 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:28,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:28,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:28,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,617 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,618 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:28,618 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:28,618 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,618 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 14:06:28,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,684 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690034788417Consolidate snapshot: snaptb0-testExportFileSystemState at 1690034788617 (+200 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690034788617Writing data manifest for snaptb0-testExportFileSystemState at 1690034788624 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690034788647 (+23 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690034788684 (+37 ms) 2023-07-22 14:06:28,686 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 14:06:28,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 267 msec 2023-07-22 14:06:28,723 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:28,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:06:28,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:28,726 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726 2023-07-22 14:06:28,726 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42431, tgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726, rawTgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:28,751 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:28,752 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1580508690_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,752 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 14:06:28,765 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 14:06:28,792 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,792 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,793 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,793 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,793 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,794 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,794 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,869 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-1229731945550534670.jar 2023-07-22 14:06:28,870 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,870 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,871 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,871 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,871 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,872 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:28,872 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:06:28,872 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:06:28,873 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:06:28,873 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:06:28,873 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:06:28,874 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:06:28,874 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:06:28,874 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:06:28,875 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:06:28,875 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:06:28,876 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:28,876 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:28,876 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:28,877 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:28,877 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:28,877 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:28,877 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:29,807 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:06:29,810 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 14:06:29,813 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 14:06:31,589 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:31,592 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:31,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0001_000001 (auth:SIMPLE) 2023-07-22 14:06:32,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0002_000001 (auth:SIMPLE) 2023-07-22 14:06:32,636 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:06:36,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0002_000001 (auth:SIMPLE) 2023-07-22 14:06:39,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0002_000001 (auth:SIMPLE) 2023-07-22 14:06:41,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0002_000001 (auth:SIMPLE) 2023-07-22 14:06:43,437 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:06:43,438 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:06:43,445 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 14:06:43,445 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:06:43,446 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:06:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 14:06:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 14:06:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 14:06:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 14:06:43,447 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 14:06:43,447 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034788726/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 14:06:43,454 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 14:06:43,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 14:06:43,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 14:06:43,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034803460"}]},"ts":"1690034803460"} 2023-07-22 14:06:43,462 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 14:06:43,464 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 14:06:43,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, UNASSIGN}] 2023-07-22 14:06:43,467 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, UNASSIGN 2023-07-22 14:06:43,467 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, UNASSIGN 2023-07-22 14:06:43,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5c1570c65224f4d4a29a3b8fe97fd535, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:43,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034803468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034803468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034803468"}]},"ts":"1690034803468"} 2023-07-22 14:06:43,468 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e0cf2d6eab806f25bcdf342d2db05b55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:43,468 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034803468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034803468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034803468"}]},"ts":"1690034803468"} 2023-07-22 14:06:43,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 5c1570c65224f4d4a29a3b8fe97fd535, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:06:43,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure e0cf2d6eab806f25bcdf342d2db05b55, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:06:43,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 14:06:43,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:43,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5c1570c65224f4d4a29a3b8fe97fd535, disabling compactions & flushes 2023-07-22 14:06:43,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:43,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:43,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. after waiting 0 ms 2023-07-22 14:06:43,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:43,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:43,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0cf2d6eab806f25bcdf342d2db05b55, disabling compactions & flushes 2023-07-22 14:06:43,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:43,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:43,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. after waiting 0 ms 2023-07-22 14:06:43,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:43,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:06:43,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:06:43,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:43,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535. 2023-07-22 14:06:43,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5c1570c65224f4d4a29a3b8fe97fd535: 2023-07-22 14:06:43,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:06:43,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55. 2023-07-22 14:06:43,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0cf2d6eab806f25bcdf342d2db05b55: 2023-07-22 14:06:43,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:43,643 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5c1570c65224f4d4a29a3b8fe97fd535, regionState=CLOSED 2023-07-22 14:06:43,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:43,643 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034803643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034803643"}]},"ts":"1690034803643"} 2023-07-22 14:06:43,643 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e0cf2d6eab806f25bcdf342d2db05b55, regionState=CLOSED 2023-07-22 14:06:43,644 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690034803643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034803643"}]},"ts":"1690034803643"} 2023-07-22 14:06:43,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-22 14:06:43,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 5c1570c65224f4d4a29a3b8fe97fd535, server=jenkins-hbase4.apache.org,45383,1690034759616 in 175 msec 2023-07-22 14:06:43,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-22 14:06:43,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure e0cf2d6eab806f25bcdf342d2db05b55, server=jenkins-hbase4.apache.org,45699,1690034759741 in 175 msec 2023-07-22 14:06:43,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c1570c65224f4d4a29a3b8fe97fd535, UNASSIGN in 181 msec 2023-07-22 14:06:43,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-22 14:06:43,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e0cf2d6eab806f25bcdf342d2db05b55, UNASSIGN in 182 msec 2023-07-22 14:06:43,650 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034803650"}]},"ts":"1690034803650"} 2023-07-22 14:06:43,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 14:06:43,653 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 14:06:43,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-22 14:06:43,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 14:06:43,762 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 14:06:43,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 14:06:43,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 14:06:43,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,770 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 14:06:43,773 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,773 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,773 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,773 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 14:06:43,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 14:06:43,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 14:06:43,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 14:06:43,774 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:43,774 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:43,776 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/recovered.edits] 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,777 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/recovered.edits] 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:43,776 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 14:06:43,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:43,778 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:43,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 14:06:43,784 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/cf/0268328144bb49d98ea5674a71b1e519 2023-07-22 14:06:43,785 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/cf/2d5ee7bb0b60499c99637610341603c0 2023-07-22 14:06:43,788 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535/recovered.edits/9.seqid 2023-07-22 14:06:43,789 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/5c1570c65224f4d4a29a3b8fe97fd535 2023-07-22 14:06:43,789 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55/recovered.edits/9.seqid 2023-07-22 14:06:43,790 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemState/e0cf2d6eab806f25bcdf342d2db05b55 2023-07-22 14:06:43,790 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 14:06:43,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,795 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 14:06:43,797 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 14:06:43,798 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,798 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 14:06:43,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034803798"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:43,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034803798"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:43,800 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:06:43,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5c1570c65224f4d4a29a3b8fe97fd535, NAME => 'testtb-testExportFileSystemState,,1690034787364.5c1570c65224f4d4a29a3b8fe97fd535.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e0cf2d6eab806f25bcdf342d2db05b55, NAME => 'testtb-testExportFileSystemState,1,1690034787364.e0cf2d6eab806f25bcdf342d2db05b55.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:06:43,800 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 14:06:43,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034803800"}]},"ts":"9223372036854775807"} 2023-07-22 14:06:43,802 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 14:06:43,804 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 14:06:43,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-22 14:06:43,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 14:06:43,879 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 14:06:43,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 14:06:43,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 14:06:43,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 14:06:43,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 14:06:43,939 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 756) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:34377 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2065 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:40536 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-473309606_1 at /127.0.0.1:46724 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-473309606_1 at /127.0.0.1:40510 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:44962 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:46748 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 350), ProcessCount=183 (was 183), AvailableMemoryMB=6609 (was 6771) 2023-07-22 14:06:43,939 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-22 14:06:43,959 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=183, AvailableMemoryMB=6613 2023-07-22 14:06:43,959 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-22 14:06:43,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:06:43,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:06:43,964 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:06:43,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 14:06:43,965 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:06:43,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 14:06:43,967 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:43,967 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:43,968 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d empty. 2023-07-22 14:06:43,968 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 empty. 2023-07-22 14:06:43,968 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:43,968 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:43,968 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 14:06:43,986 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 14:06:43,988 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ed7b601c57b5a1baf2f16f2b464a394d, NAME => 'testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:43,988 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 501056e6b7fecd7f96771247b9628647, NAME => 'testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:06:44,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 501056e6b7fecd7f96771247b9628647, disabling compactions & flushes 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:44,007 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ed7b601c57b5a1baf2f16f2b464a394d, disabling compactions & flushes 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,007 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. after waiting 0 ms 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. after waiting 0 ms 2023-07-22 14:06:44,008 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,008 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,008 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 501056e6b7fecd7f96771247b9628647: 2023-07-22 14:06:44,008 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,008 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ed7b601c57b5a1baf2f16f2b464a394d: 2023-07-22 14:06:44,011 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:06:44,012 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804012"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034804012"}]},"ts":"1690034804012"} 2023-07-22 14:06:44,012 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804012"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034804012"}]},"ts":"1690034804012"} 2023-07-22 14:06:44,017 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:06:44,018 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:06:44,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034804018"}]},"ts":"1690034804018"} 2023-07-22 14:06:44,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 14:06:44,024 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:06:44,026 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:06:44,026 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:06:44,026 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:06:44,026 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:06:44,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, ASSIGN}] 2023-07-22 14:06:44,029 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, ASSIGN 2023-07-22 14:06:44,029 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, ASSIGN 2023-07-22 14:06:44,030 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:06:44,030 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:06:44,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 14:06:44,181 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:06:44,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=501056e6b7fecd7f96771247b9628647, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ed7b601c57b5a1baf2f16f2b464a394d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034804183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034804183"}]},"ts":"1690034804183"} 2023-07-22 14:06:44,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034804183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034804183"}]},"ts":"1690034804183"} 2023-07-22 14:06:44,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 501056e6b7fecd7f96771247b9628647, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:06:44,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure ed7b601c57b5a1baf2f16f2b464a394d, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:06:44,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 14:06:44,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 501056e6b7fecd7f96771247b9628647, NAME => 'testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:06:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. service=AccessControlService 2023-07-22 14:06:44,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:44,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed7b601c57b5a1baf2f16f2b464a394d, NAME => 'testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:06:44,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. service=AccessControlService 2023-07-22 14:06:44,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:06:44,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:06:44,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,346 INFO [StoreOpener-501056e6b7fecd7f96771247b9628647-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,347 INFO [StoreOpener-ed7b601c57b5a1baf2f16f2b464a394d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,347 DEBUG [StoreOpener-501056e6b7fecd7f96771247b9628647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf 2023-07-22 14:06:44,347 DEBUG [StoreOpener-501056e6b7fecd7f96771247b9628647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf 2023-07-22 14:06:44,348 INFO [StoreOpener-501056e6b7fecd7f96771247b9628647-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 501056e6b7fecd7f96771247b9628647 columnFamilyName cf 2023-07-22 14:06:44,348 DEBUG [StoreOpener-ed7b601c57b5a1baf2f16f2b464a394d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf 2023-07-22 14:06:44,348 INFO [StoreOpener-501056e6b7fecd7f96771247b9628647-1] regionserver.HStore(310): Store=501056e6b7fecd7f96771247b9628647/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:44,348 DEBUG [StoreOpener-ed7b601c57b5a1baf2f16f2b464a394d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf 2023-07-22 14:06:44,349 INFO [StoreOpener-ed7b601c57b5a1baf2f16f2b464a394d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed7b601c57b5a1baf2f16f2b464a394d columnFamilyName cf 2023-07-22 14:06:44,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,349 INFO [StoreOpener-ed7b601c57b5a1baf2f16f2b464a394d-1] regionserver.HStore(310): Store=ed7b601c57b5a1baf2f16f2b464a394d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:06:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 501056e6b7fecd7f96771247b9628647 2023-07-22 14:06:44,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:06:44,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:44,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 501056e6b7fecd7f96771247b9628647; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67637240, jitterRate=0.00787341594696045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:44,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 501056e6b7fecd7f96771247b9628647: 2023-07-22 14:06:44,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647., pid=45, masterSystemTime=1690034804337 2023-07-22 14:06:44,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:06:44,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed7b601c57b5a1baf2f16f2b464a394d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64588193, jitterRate=-0.037560924887657166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:06:44,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed7b601c57b5a1baf2f16f2b464a394d: 2023-07-22 14:06:44,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d., pid=46, masterSystemTime=1690034804339 2023-07-22 14:06:44,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,359 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=501056e6b7fecd7f96771247b9628647, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034804358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034804358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034804358"}]},"ts":"1690034804358"} 2023-07-22 14:06:44,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ed7b601c57b5a1baf2f16f2b464a394d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034804360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034804360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034804360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034804360"}]},"ts":"1690034804360"} 2023-07-22 14:06:44,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 14:06:44,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 501056e6b7fecd7f96771247b9628647, server=jenkins-hbase4.apache.org,45699,1690034759741 in 175 msec 2023-07-22 14:06:44,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 14:06:44,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure ed7b601c57b5a1baf2f16f2b464a394d, server=jenkins-hbase4.apache.org,39735,1690034759682 in 175 msec 2023-07-22 14:06:44,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, ASSIGN in 337 msec 2023-07-22 14:06:44,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-22 14:06:44,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, ASSIGN in 338 msec 2023-07-22 14:06:44,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:06:44,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034804367"}]},"ts":"1690034804367"} 2023-07-22 14:06:44,368 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 14:06:44,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:06:44,371 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 14:06:44,373 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 14:06:44,375 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:44,375 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:44,375 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:44,375 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:06:44,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:44,376 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:44,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:44,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 14:06:44,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 415 msec 2023-07-22 14:06:44,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 14:06:44,569 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 14:06:44,569 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-22 14:06:44,569 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:44,572 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-22 14:06:44,573 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:44,573 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-22 14:06:44,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034804576 (current time:1690034804576). 2023-07-22 14:06:44,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:44,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x34792b46 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:44,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7320597e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:44,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,591 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34792b46 to 127.0.0.1:59777 2023-07-22 14:06:44,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:44,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x45294803 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:44,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38f778fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:44,599 DEBUG [hconnection-0x49ed2d32-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,602 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,608 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45294803 to 127.0.0.1:59777 2023-07-22 14:06:44,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:44,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 14:06:44,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:44,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,614 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,614 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690035404614 2023-07-22 14:06:44,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 14:06:44,616 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:44,616 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:44,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:44,620 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-22 14:06:44,622 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:44,623 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690035404623 2023-07-22 14:06:44,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,637 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 14:06:44,637 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:44,638 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 14:06:44,638 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 14:06:44,638 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,638 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,641 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,641 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,641 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,642 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:44,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:44,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:44,649 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:44,649 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:44,649 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:44,650 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,650 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:44,651 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:44,653 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,653 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ca688ce[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:44,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 14:06:44,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ca688ce[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:44,656 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 14:06:44,656 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:44,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:44,659 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. started... 2023-07-22 14:06:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,659 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:44,659 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:44,660 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 501056e6b7fecd7f96771247b9628647: 2023-07-22 14:06:44,659 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:44,660 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:44,660 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,660 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:44,661 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:44,661 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:44,661 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,661 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. started... 2023-07-22 14:06:44,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed7b601c57b5a1baf2f16f2b464a394d: 2023-07-22 14:06:44,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:44,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:06:44,666 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:44,666 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:44,666 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:44,680 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. completed. 2023-07-22 14:06:44,680 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:44,682 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. completed. 2023-07-22 14:06:44,682 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,682 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:44,682 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:44,682 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,682 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:44,682 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:44,683 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,683 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:44,683 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:44,683 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:44,685 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,685 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:44,685 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:44,686 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:06:44,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 14:06:44,696 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 14:06:44,696 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:44,696 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:44,696 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,696 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:44,701 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,701 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,701 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,701 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,701 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:44,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,702 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:44,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,703 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,703 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:44,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:44,706 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,706 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,707 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,710 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,710 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:44,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:44,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:44,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:44,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:44,716 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 14:06:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:44,718 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:44,731 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 14:06:44,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 14:06:44,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,767 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 14:06:44,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690034804615Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690034804711 (+96 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690034804711Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690034804716 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690034804735 (+19 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690034804767 (+32 ms) 2023-07-22 14:06:44,770 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:44,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 155 msec 2023-07-22 14:06:44,918 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:44,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 14:06:44,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39735] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:44,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:06:44,932 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 14:06:44,932 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:44,934 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:06:44,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034804949 (current time:1690034804949). 2023-07-22 14:06:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:06:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x5b90398f to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d9cd00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:44,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,965 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b90398f to 127.0.0.1:59777 2023-07-22 14:06:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:44,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x07281ff5 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:06:44,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dae12de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:06:44,974 DEBUG [hconnection-0x155765a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,977 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:06:44,983 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:06:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07281ff5 to 127.0.0.1:59777 2023-07-22 14:06:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:06:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 14:06:44,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:06:44,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,989 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,990 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690035404990 2023-07-22 14:06:44,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 14:06:44,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 14:06:44,991 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:06:44,991 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:06:44,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:44,993 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 14:06:44,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-22 14:06:44,995 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:44,996 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690035404996 2023-07-22 14:06:45,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 14:06:45,028 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 14:06:45,028 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:45,029 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 14:06:45,029 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 14:06:45,030 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,030 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,033 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,033 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,033 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,033 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,034 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,034 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 14:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,035 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:45,035 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 14:06:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:45,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 14:06:45,037 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:45,037 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:45,038 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:45,038 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:45,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 14:06:45,038 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 14:06:45,038 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:06:45,039 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 14:06:45,039 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 14:06:45,039 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 14:06:45,040 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,040 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:45,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:45,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:45,041 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,041 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:45,041 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,042 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,042 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e4b17[Count = 1] remaining members to acquire global barrier 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:45,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 14:06:45,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e4b17[Count = 0] remaining members to acquire global barrier 2023-07-22 14:06:45,046 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 14:06:45,046 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:45,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:45,048 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:06:45,049 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. started... 2023-07-22 14:06:45,049 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,049 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:06:45,049 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:45,049 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed7b601c57b5a1baf2f16f2b464a394d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 14:06:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:06:45,049 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. started... 2023-07-22 14:06:45,049 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 501056e6b7fecd7f96771247b9628647 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 14:06:45,050 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:45,050 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:45,050 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:45,065 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/.tmp/cf/e233fd0520a2479681950086548f5a40 2023-07-22 14:06:45,065 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/.tmp/cf/8c1cbd9d707146d1af46a4d435a891ba 2023-07-22 14:06:45,075 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/.tmp/cf/e233fd0520a2479681950086548f5a40 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40 2023-07-22 14:06:45,075 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/.tmp/cf/8c1cbd9d707146d1af46a4d435a891ba as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba 2023-07-22 14:06:45,081 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba, entries=47, sequenceid=6, filesize=8 K 2023-07-22 14:06:45,081 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 14:06:45,082 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ed7b601c57b5a1baf2f16f2b464a394d in 33ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:45,082 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 501056e6b7fecd7f96771247b9628647 in 33ms, sequenceid=6, compaction requested=false 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed7b601c57b5a1baf2f16f2b464a394d: 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 501056e6b7fecd7f96771247b9628647: 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40] hfiles 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba] hfiles 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba for snapshot=snaptb0-testConsecutiveExports 2023-07-22 14:06:45,083 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 14:06:45,091 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:45,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 14:06:45,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:06:45,093 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:06:45,095 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. completed. 2023-07-22 14:06:45,095 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:06:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,100 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:45,100 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:06:45,101 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:45,102 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:45,102 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:45,104 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. completed. 2023-07-22 14:06:45,104 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:06:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:06:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:06:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 14:06:45,104 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:06:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,106 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,106 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 14:06:45,106 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:45,106 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 14:06:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:06:45,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 14:06:45,113 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 14:06:45,114 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:06:45,114 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:06:45,114 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 14:06:45,114 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:06:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:06:45,117 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,117 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:06:45,118 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:06:45,119 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:06:45,126 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 14:06:45,126 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,127 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,135 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:06:45,138 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,138 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 14:06:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,135 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 14:06:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,137 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:06:45,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:06:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:06:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:06:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:06:45,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 14:06:45,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,188 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690034804990Consolidate snapshot: snaptb0-testConsecutiveExports at 1690034805138 (+148 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690034805138Writing data manifest for snaptb0-testConsecutiveExports at 1690034805144 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690034805154 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690034805188 (+34 ms) 2023-07-22 14:06:45,191 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 14:06:45,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 200 msec 2023-07-22 14:06:45,293 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:06:45,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 14:06:45,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:06:45,295 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295 2023-07-22 14:06:45,295 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:45,329 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:06:45,329 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@52c181df, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,329 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 14:06:45,341 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:06:45,360 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,360 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,361 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,361 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,361 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,435 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-5821266510260202948.jar 2023-07-22 14:06:45,436 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,436 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,437 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,437 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,437 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,438 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:06:45,438 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:06:45,439 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:06:45,439 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:06:45,439 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:06:45,440 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:06:45,440 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:06:45,441 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:06:45,441 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:06:45,441 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:06:45,442 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:06:45,442 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:45,443 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:45,443 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:45,443 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:45,444 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:06:45,444 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:45,444 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:06:45,853 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:06:45,856 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 14:06:45,858 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 14:06:48,150 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:48,150 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:06:48,153 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0002_000001 (auth:SIMPLE) 2023-07-22 14:06:48,599 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0003_000001 (auth:SIMPLE) 2023-07-22 14:06:49,232 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:06:52,829 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0003_000001 (auth:SIMPLE) 2023-07-22 14:06:55,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0003_000001 (auth:SIMPLE) 2023-07-22 14:06:58,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0003_000001 (auth:SIMPLE) 2023-07-22 14:07:00,048 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:07:00,049 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:07:00,052 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 14:07:00,052 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:07:00,053 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:07:00,053 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 14:07:00,056 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 14:07:00,056 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 14:07:00,056 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@33a81baf in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 14:07:00,057 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 14:07:00,057 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 14:07:00,058 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:00,080 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:00,080 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@74df2f75, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:07:00,080 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 14:07:00,092 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 14:07:00,104 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,104 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,105 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,105 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,105 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,106 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,106 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,174 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-7266082623346813496.jar 2023-07-22 14:07:00,175 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,175 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,176 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,176 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,176 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,176 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:00,177 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:07:00,177 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:07:00,177 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:07:00,178 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:07:00,178 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:07:00,179 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:07:00,179 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:07:00,179 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:07:00,180 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:07:00,180 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:07:00,181 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:00,181 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:00,181 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:00,181 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:00,182 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:00,182 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:00,182 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:00,530 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:07:00,532 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 14:07:00,535 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 14:07:04,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:04,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:04,437 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0003_000001 (auth:SIMPLE) 2023-07-22 14:07:05,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0004_000001 (auth:SIMPLE) 2023-07-22 14:07:09,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0004_000001 (auth:SIMPLE) 2023-07-22 14:07:11,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0004_000001 (auth:SIMPLE) 2023-07-22 14:07:16,783 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:07:16,784 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:07:16,787 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 14:07:16,788 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:07:16,788 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:07:16,788 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 14:07:16,794 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 14:07:16,794 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 14:07:16,795 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@33a81baf in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 14:07:16,795 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 14:07:16,795 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/local-export-1690034805295/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 14:07:16,813 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 14:07:16,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 14:07:16,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:16,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 14:07:16,828 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034836828"}]},"ts":"1690034836828"} 2023-07-22 14:07:16,830 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 14:07:16,832 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 14:07:16,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, UNASSIGN}] 2023-07-22 14:07:16,836 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, UNASSIGN 2023-07-22 14:07:16,838 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, UNASSIGN 2023-07-22 14:07:16,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=501056e6b7fecd7f96771247b9628647, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:16,839 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034836838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034836838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034836838"}]},"ts":"1690034836838"} 2023-07-22 14:07:16,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ed7b601c57b5a1baf2f16f2b464a394d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:16,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034836840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034836840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034836840"}]},"ts":"1690034836840"} 2023-07-22 14:07:16,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 501056e6b7fecd7f96771247b9628647, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:16,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure ed7b601c57b5a1baf2f16f2b464a394d, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:16,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 14:07:16,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 501056e6b7fecd7f96771247b9628647 2023-07-22 14:07:16,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 501056e6b7fecd7f96771247b9628647, disabling compactions & flushes 2023-07-22 14:07:16,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:07:16,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:07:16,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. after waiting 0 ms 2023-07-22 14:07:16,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:07:16,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:07:16,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed7b601c57b5a1baf2f16f2b464a394d, disabling compactions & flushes 2023-07-22 14:07:16,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:07:16,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:07:16,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. after waiting 0 ms 2023-07-22 14:07:16,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:07:17,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:17,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:17,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647. 2023-07-22 14:07:17,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 501056e6b7fecd7f96771247b9628647: 2023-07-22 14:07:17,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:17,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:17,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 501056e6b7fecd7f96771247b9628647 2023-07-22 14:07:17,055 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=501056e6b7fecd7f96771247b9628647, regionState=CLOSED 2023-07-22 14:07:17,056 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034837055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034837055"}]},"ts":"1690034837055"} 2023-07-22 14:07:17,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d. 2023-07-22 14:07:17,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed7b601c57b5a1baf2f16f2b464a394d: 2023-07-22 14:07:17,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:07:17,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ed7b601c57b5a1baf2f16f2b464a394d, regionState=CLOSED 2023-07-22 14:07:17,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690034837060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034837060"}]},"ts":"1690034837060"} 2023-07-22 14:07:17,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-22 14:07:17,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 501056e6b7fecd7f96771247b9628647, server=jenkins-hbase4.apache.org,45699,1690034759741 in 216 msec 2023-07-22 14:07:17,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-22 14:07:17,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure ed7b601c57b5a1baf2f16f2b464a394d, server=jenkins-hbase4.apache.org,39735,1690034759682 in 218 msec 2023-07-22 14:07:17,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=501056e6b7fecd7f96771247b9628647, UNASSIGN in 229 msec 2023-07-22 14:07:17,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-22 14:07:17,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed7b601c57b5a1baf2f16f2b464a394d, UNASSIGN in 231 msec 2023-07-22 14:07:17,068 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034837068"}]},"ts":"1690034837068"} 2023-07-22 14:07:17,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 14:07:17,072 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 14:07:17,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 258 msec 2023-07-22 14:07:17,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 14:07:17,129 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 14:07:17,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 14:07:17,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,135 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 14:07:17,136 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,139 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 14:07:17,144 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,144 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,144 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,144 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 14:07:17,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 14:07:17,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 14:07:17,145 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:07:17,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:07:17,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,147 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 14:07:17,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,147 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 14:07:17,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-22 14:07:17,148 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:07:17,150 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/recovered.edits] 2023-07-22 14:07:17,150 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/recovered.edits] 2023-07-22 14:07:17,159 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/cf/e233fd0520a2479681950086548f5a40 2023-07-22 14:07:17,167 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/cf/8c1cbd9d707146d1af46a4d435a891ba 2023-07-22 14:07:17,171 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d/recovered.edits/9.seqid 2023-07-22 14:07:17,171 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647/recovered.edits/9.seqid 2023-07-22 14:07:17,172 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/ed7b601c57b5a1baf2f16f2b464a394d 2023-07-22 14:07:17,172 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testConsecutiveExports/501056e6b7fecd7f96771247b9628647 2023-07-22 14:07:17,172 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 14:07:17,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,177 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 14:07:17,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 14:07:17,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 14:07:17,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034837181"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:17,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034837181"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:17,185 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:07:17,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ed7b601c57b5a1baf2f16f2b464a394d, NAME => 'testtb-testConsecutiveExports,,1690034803960.ed7b601c57b5a1baf2f16f2b464a394d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 501056e6b7fecd7f96771247b9628647, NAME => 'testtb-testConsecutiveExports,1,1690034803960.501056e6b7fecd7f96771247b9628647.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:07:17,185 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 14:07:17,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034837185"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:17,191 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 14:07:17,194 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 14:07:17,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 63 msec 2023-07-22 14:07:17,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 14:07:17,249 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 14:07:17,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 14:07:17,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 14:07:17,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 14:07:17,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 14:07:17,352 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 770), OpenFileDescriptor=897 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=355 (was 335) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=6656 (was 6613) - AvailableMemoryMB LEAK? - 2023-07-22 14:07:17,352 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-22 14:07:17,375 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=355, ProcessCount=185, AvailableMemoryMB=6655 2023-07-22 14:07:17,375 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-22 14:07:17,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:07:17,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:17,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:07:17,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 14:07:17,385 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:07:17,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 14:07:17,389 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,390 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,390 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 empty. 2023-07-22 14:07:17,391 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea empty. 2023-07-22 14:07:17,391 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,391 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,392 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 14:07:17,412 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 14:07:17,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b046d70e901b54cd459852228a2b4b3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:17,414 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c826fa4f095b82c7b7522c1fd5e3f1ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:17,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:17,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c826fa4f095b82c7b7522c1fd5e3f1ea, disabling compactions & flushes 2023-07-22 14:07:17,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. after waiting 0 ms 2023-07-22 14:07:17,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c826fa4f095b82c7b7522c1fd5e3f1ea: 2023-07-22 14:07:17,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:17,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0b046d70e901b54cd459852228a2b4b3, disabling compactions & flushes 2023-07-22 14:07:17,443 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. after waiting 0 ms 2023-07-22 14:07:17,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0b046d70e901b54cd459852228a2b4b3: 2023-07-22 14:07:17,446 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:07:17,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034837447"}]},"ts":"1690034837447"} 2023-07-22 14:07:17,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034837447"}]},"ts":"1690034837447"} 2023-07-22 14:07:17,453 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:07:17,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:07:17,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034837455"}]},"ts":"1690034837455"} 2023-07-22 14:07:17,456 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 14:07:17,459 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:07:17,461 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:07:17,461 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:07:17,461 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:07:17,461 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:07:17,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, ASSIGN}] 2023-07-22 14:07:17,464 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, ASSIGN 2023-07-22 14:07:17,464 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, ASSIGN 2023-07-22 14:07:17,465 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45383,1690034759616; forceNewPlan=false, retain=false 2023-07-22 14:07:17,465 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:07:17,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 14:07:17,616 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:07:17,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b046d70e901b54cd459852228a2b4b3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:17,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c826fa4f095b82c7b7522c1fd5e3f1ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:17,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034837619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034837619"}]},"ts":"1690034837619"} 2023-07-22 14:07:17,619 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034837619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034837619"}]},"ts":"1690034837619"} 2023-07-22 14:07:17,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 0b046d70e901b54cd459852228a2b4b3, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:17,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c826fa4f095b82c7b7522c1fd5e3f1ea, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:07:17,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 14:07:17,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b046d70e901b54cd459852228a2b4b3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:07:17,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. service=AccessControlService 2023-07-22 14:07:17,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,792 INFO [StoreOpener-0b046d70e901b54cd459852228a2b4b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c826fa4f095b82c7b7522c1fd5e3f1ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:07:17,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. service=AccessControlService 2023-07-22 14:07:17,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:17,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:17,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,799 DEBUG [StoreOpener-0b046d70e901b54cd459852228a2b4b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf 2023-07-22 14:07:17,799 DEBUG [StoreOpener-0b046d70e901b54cd459852228a2b4b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf 2023-07-22 14:07:17,800 INFO [StoreOpener-c826fa4f095b82c7b7522c1fd5e3f1ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,801 INFO [StoreOpener-0b046d70e901b54cd459852228a2b4b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b046d70e901b54cd459852228a2b4b3 columnFamilyName cf 2023-07-22 14:07:17,801 DEBUG [StoreOpener-c826fa4f095b82c7b7522c1fd5e3f1ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf 2023-07-22 14:07:17,802 DEBUG [StoreOpener-c826fa4f095b82c7b7522c1fd5e3f1ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf 2023-07-22 14:07:17,802 INFO [StoreOpener-0b046d70e901b54cd459852228a2b4b3-1] regionserver.HStore(310): Store=0b046d70e901b54cd459852228a2b4b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:17,802 INFO [StoreOpener-c826fa4f095b82c7b7522c1fd5e3f1ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c826fa4f095b82c7b7522c1fd5e3f1ea columnFamilyName cf 2023-07-22 14:07:17,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,803 INFO [StoreOpener-c826fa4f095b82c7b7522c1fd5e3f1ea-1] regionserver.HStore(310): Store=c826fa4f095b82c7b7522c1fd5e3f1ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:17,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:17,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:17,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:17,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b046d70e901b54cd459852228a2b4b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68570485, jitterRate=0.021779850125312805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:17,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b046d70e901b54cd459852228a2b4b3: 2023-07-22 14:07:17,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:17,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c826fa4f095b82c7b7522c1fd5e3f1ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65850460, jitterRate=-0.018751680850982666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:17,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c826fa4f095b82c7b7522c1fd5e3f1ea: 2023-07-22 14:07:17,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea., pid=61, masterSystemTime=1690034837777 2023-07-22 14:07:17,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3., pid=60, masterSystemTime=1690034837776 2023-07-22 14:07:17,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:17,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c826fa4f095b82c7b7522c1fd5e3f1ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:17,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034837817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034837817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034837817"}]},"ts":"1690034837817"} 2023-07-22 14:07:17,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:17,819 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b046d70e901b54cd459852228a2b4b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:17,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034837819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034837819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034837819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034837819"}]},"ts":"1690034837819"} 2023-07-22 14:07:17,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-22 14:07:17,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c826fa4f095b82c7b7522c1fd5e3f1ea, server=jenkins-hbase4.apache.org,45383,1690034759616 in 199 msec 2023-07-22 14:07:17,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-22 14:07:17,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 0b046d70e901b54cd459852228a2b4b3, server=jenkins-hbase4.apache.org,45699,1690034759741 in 202 msec 2023-07-22 14:07:17,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, ASSIGN in 364 msec 2023-07-22 14:07:17,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-22 14:07:17,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, ASSIGN in 365 msec 2023-07-22 14:07:17,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:07:17,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034837831"}]},"ts":"1690034837831"} 2023-07-22 14:07:17,833 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 14:07:17,840 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:07:17,841 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 14:07:17,844 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 14:07:17,848 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,848 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,848 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,848 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:17,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:17,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:17,851 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:17,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:17,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 474 msec 2023-07-22 14:07:17,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 14:07:17,991 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 14:07:17,991 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-22 14:07:17,992 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:17,999 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-22 14:07:17,999 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:17,999 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-22 14:07:18,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034838003 (current time:1690034838003). 2023-07-22 14:07:18,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:18,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x095857f8 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:18,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd4d7aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:18,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,014 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x095857f8 to 127.0.0.1:59777 2023-07-22 14:07:18,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:18,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x4cc198ef to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:18,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76df118, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:18,027 DEBUG [hconnection-0x7cff0fd8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,028 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,034 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cc198ef to 127.0.0.1:59777 2023-07-22 14:07:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 14:07:18,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:18,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,041 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,042 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690035438042 2023-07-22 14:07:18,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,043 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:18,044 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:18,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:18,045 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-22 14:07:18,047 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:18,048 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690035438048 2023-07-22 14:07:18,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,080 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 14:07:18,080 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:18,082 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 14:07:18,082 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 14:07:18,082 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,082 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,084 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,084 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,084 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,084 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,086 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,086 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,087 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,087 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:18,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 14:07:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:18,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,090 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:18,090 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:18,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,090 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:18,090 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:18,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:18,093 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:18,093 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:18,093 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:18,093 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:18,093 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:18,095 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:18,095 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:18,095 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:18,095 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:18,096 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,096 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:18,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:18,098 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,098 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,098 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,098 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:18,098 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:18,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 14:07:18,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5afb3958[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:18,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 14:07:18,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5afb3958[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:18,103 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 14:07:18,103 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:18,105 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:18,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:18,106 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,106 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:18,106 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:18,107 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. started... 2023-07-22 14:07:18,114 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:18,114 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:18,114 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b046d70e901b54cd459852228a2b4b3: 2023-07-22 14:07:18,114 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:18,114 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:18,114 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,114 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:18,114 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. started... 2023-07-22 14:07:18,114 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:18,114 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:18,117 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:18,117 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c826fa4f095b82c7b7522c1fd5e3f1ea: 2023-07-22 14:07:18,117 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,117 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:18,117 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:18,144 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:18,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:18,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:18,149 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:18,149 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. completed. 2023-07-22 14:07:18,149 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:18,153 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:18,153 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:18,154 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:18,155 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. completed. 2023-07-22 14:07:18,155 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:18,156 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:18,157 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:18,159 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:18,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:18,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:18,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 14:07:18,168 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 14:07:18,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:18,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:18,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,168 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:18,170 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,170 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,170 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,171 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:18,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:18,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,173 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:18,174 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,175 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,177 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,178 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,178 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,183 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,183 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,183 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,183 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,190 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,191 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:18,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:18,191 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,192 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,349 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:18,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:18,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:18,350 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 14:07:18,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 14:07:18,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,390 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690034838042Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690034838192 (+150 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690034838192Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690034838200 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690034838251 (+51 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690034838390 (+139 ms) 2023-07-22 14:07:18,393 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:18,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 350 msec 2023-07-22 14:07:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:18,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:18,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:18,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:18,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45383] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:18,678 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:18,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034838696 (current time:1690034838696). 2023-07-22 14:07:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x3622f5b4 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@480e6ee6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:18,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,721 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3622f5b4 to 127.0.0.1:59777 2023-07-22 14:07:18,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:18,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x4e7e2603 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:18,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fd0f52d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:18,847 DEBUG [hconnection-0x5412df6f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,851 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:18,861 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:18,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e7e2603 to 127.0.0.1:59777 2023-07-22 14:07:18,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:18,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 14:07:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,872 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,873 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690035438873 2023-07-22 14:07:18,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 14:07:18,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,875 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:18,875 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:18,882 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 14:07:18,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:18,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 14 msec 2023-07-22 14:07:18,891 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:18,892 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690035438892 2023-07-22 14:07:18,975 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:18,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:18,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,978 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 14:07:18,983 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:18,983 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 14:07:18,983 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 14:07:18,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:18,983 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:18,983 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,983 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:18,985 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,985 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,985 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 14:07:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,032 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:19,039 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,039 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:19,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,039 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 14:07:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,041 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:19,041 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,041 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:19,041 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:19,041 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:19,041 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:19,043 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 14:07:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 14:07:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:19,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,047 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:19,047 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:19,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 14:07:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:19,052 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 14:07:19,053 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 14:07:19,053 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 14:07:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,058 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:19,063 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,063 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,063 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:19,063 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,063 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:19,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d842b9a[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:19,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 14:07:19,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d842b9a[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:19,070 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 14:07:19,070 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,071 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 14:07:19,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,072 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:19,074 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:19,074 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. started... 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:19,075 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c826fa4f095b82c7b7522c1fd5e3f1ea 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 14:07:19,074 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:19,075 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. started... 2023-07-22 14:07:19,075 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b046d70e901b54cd459852228a2b4b3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 14:07:19,111 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/.tmp/cf/1ca6ca56cbf3434a9df5b3804ee5a894 2023-07-22 14:07:19,120 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/.tmp/cf/642e79a6c3254bae91b19f42321abaa5 2023-07-22 14:07:19,124 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/.tmp/cf/1ca6ca56cbf3434a9df5b3804ee5a894 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894 2023-07-22 14:07:19,128 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/.tmp/cf/642e79a6c3254bae91b19f42321abaa5 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5 2023-07-22 14:07:19,132 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 14:07:19,133 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0b046d70e901b54cd459852228a2b4b3 in 58ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:19,133 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 14:07:19,133 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b046d70e901b54cd459852228a2b4b3: 2023-07-22 14:07:19,134 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,134 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:19,134 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894] hfiles 2023-07-22 14:07:19,134 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,135 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5, entries=47, sequenceid=6, filesize=8.0 K 2023-07-22 14:07:19,137 INFO [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c826fa4f095b82c7b7522c1fd5e3f1ea in 63ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:19,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c826fa4f095b82c7b7522c1fd5e3f1ea: 2023-07-22 14:07:19,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:19,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5] hfiles 2023-07-22 14:07:19,139 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,183 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:19,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:19,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:19,185 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 14:07:19,222 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. completed. 2023-07-22 14:07:19,222 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:19,222 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:19,222 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:19,222 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,223 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:19,223 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:19,225 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:19,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:19,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 14:07:19,265 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. completed. 2023-07-22 14:07:19,265 DEBUG [rs(jenkins-hbase4.apache.org,45383,1690034759616)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 14:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:19,270 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,270 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 14:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:19,270 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:19,270 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 14:07:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45383,1690034759616': 2023-07-22 14:07:19,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 14:07:19,287 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 14:07:19,287 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:19,287 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:19,287 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,287 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:19,298 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,298 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:19,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,300 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,300 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,300 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:19,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,301 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,301 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,304 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,304 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:19,305 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:19,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,309 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:19,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:19,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-22 14:07:19,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 14:07:19,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,440 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:19,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690034838874Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690034839310 (+436 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690034839312 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690034839322 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690034839352 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690034839440 (+88 ms) 2023-07-22 14:07:19,444 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 14:07:19,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 565 msec 2023-07-22 14:07:19,485 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:19,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 14:07:19,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:19,523 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:07:19,527 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:07:19,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39735] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 14:07:19,529 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:07:19,534 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:07:19,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45383] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 14:07:19,539 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 14:07:19,543 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 14:07:19,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 14:07:19,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:07:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:19,550 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:07:19,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 14:07:19,551 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:07:19,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 14:07:19,555 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:19,556 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:19,556 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 empty. 2023-07-22 14:07:19,556 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e empty. 2023-07-22 14:07:19,557 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:19,558 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:19,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 14:07:19,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 14:07:19,660 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 14:07:19,662 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a17ebd6c151d9cb4686f2c2b8b184e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:19,663 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => db132b65b0c79037822f000df7d94f6e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1a17ebd6c151d9cb4686f2c2b8b184e8, disabling compactions & flushes 2023-07-22 14:07:19,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. after waiting 0 ms 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:19,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:19,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1a17ebd6c151d9cb4686f2c2b8b184e8: 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing db132b65b0c79037822f000df7d94f6e, disabling compactions & flushes 2023-07-22 14:07:19,689 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. after waiting 0 ms 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:19,689 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:19,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for db132b65b0c79037822f000df7d94f6e: 2023-07-22 14:07:19,691 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:07:19,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034839692"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034839692"}]},"ts":"1690034839692"} 2023-07-22 14:07:19,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034839692"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034839692"}]},"ts":"1690034839692"} 2023-07-22 14:07:19,695 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:07:19,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:07:19,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034839696"}]},"ts":"1690034839696"} 2023-07-22 14:07:19,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 14:07:19,813 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:07:19,815 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:07:19,815 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:07:19,815 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:07:19,815 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:07:19,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, ASSIGN}] 2023-07-22 14:07:19,818 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, ASSIGN 2023-07-22 14:07:19,818 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, ASSIGN 2023-07-22 14:07:19,820 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:07:19,820 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:07:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 14:07:19,970 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:07:19,974 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1a17ebd6c151d9cb4686f2c2b8b184e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:19,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=db132b65b0c79037822f000df7d94f6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:19,974 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034839974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034839974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034839974"}]},"ts":"1690034839974"} 2023-07-22 14:07:19,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034839974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034839974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034839974"}]},"ts":"1690034839974"} 2023-07-22 14:07:19,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 1a17ebd6c151d9cb4686f2c2b8b184e8, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:19,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure db132b65b0c79037822f000df7d94f6e, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:20,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a17ebd6c151d9cb4686f2c2b8b184e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 14:07:20,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db132b65b0c79037822f000df7d94f6e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 14:07:20,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. service=AccessControlService 2023-07-22 14:07:20,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. service=AccessControlService 2023-07-22 14:07:20,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:20,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,136 INFO [StoreOpener-1a17ebd6c151d9cb4686f2c2b8b184e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,142 INFO [StoreOpener-db132b65b0c79037822f000df7d94f6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 14:07:20,168 DEBUG [StoreOpener-1a17ebd6c151d9cb4686f2c2b8b184e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf 2023-07-22 14:07:20,168 DEBUG [StoreOpener-1a17ebd6c151d9cb4686f2c2b8b184e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf 2023-07-22 14:07:20,168 DEBUG [StoreOpener-db132b65b0c79037822f000df7d94f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf 2023-07-22 14:07:20,169 DEBUG [StoreOpener-db132b65b0c79037822f000df7d94f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf 2023-07-22 14:07:20,169 INFO [StoreOpener-db132b65b0c79037822f000df7d94f6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db132b65b0c79037822f000df7d94f6e columnFamilyName cf 2023-07-22 14:07:20,168 INFO [StoreOpener-1a17ebd6c151d9cb4686f2c2b8b184e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a17ebd6c151d9cb4686f2c2b8b184e8 columnFamilyName cf 2023-07-22 14:07:20,170 INFO [StoreOpener-db132b65b0c79037822f000df7d94f6e-1] regionserver.HStore(310): Store=db132b65b0c79037822f000df7d94f6e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,171 INFO [StoreOpener-1a17ebd6c151d9cb4686f2c2b8b184e8-1] regionserver.HStore(310): Store=1a17ebd6c151d9cb4686f2c2b8b184e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:20,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:20,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a17ebd6c151d9cb4686f2c2b8b184e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71931762, jitterRate=0.07186678051948547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:20,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db132b65b0c79037822f000df7d94f6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65883160, jitterRate=-0.018264412879943848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:20,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a17ebd6c151d9cb4686f2c2b8b184e8: 2023-07-22 14:07:20,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db132b65b0c79037822f000df7d94f6e: 2023-07-22 14:07:20,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e., pid=70, masterSystemTime=1690034840130 2023-07-22 14:07:20,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8., pid=69, masterSystemTime=1690034840130 2023-07-22 14:07:20,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=db132b65b0c79037822f000df7d94f6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:20,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840239"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034840239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034840239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034840239"}]},"ts":"1690034840239"} 2023-07-22 14:07:20,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,240 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1a17ebd6c151d9cb4686f2c2b8b184e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:20,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840240"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034840240"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034840240"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034840240"}]},"ts":"1690034840240"} 2023-07-22 14:07:20,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-22 14:07:20,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 1a17ebd6c151d9cb4686f2c2b8b184e8, server=jenkins-hbase4.apache.org,45699,1690034759741 in 267 msec 2023-07-22 14:07:20,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-22 14:07:20,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure db132b65b0c79037822f000df7d94f6e, server=jenkins-hbase4.apache.org,39735,1690034759682 in 263 msec 2023-07-22 14:07:20,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, ASSIGN in 433 msec 2023-07-22 14:07:20,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-22 14:07:20,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, ASSIGN in 436 msec 2023-07-22 14:07:20,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:07:20,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034840255"}]},"ts":"1690034840255"} 2023-07-22 14:07:20,257 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 14:07:20,283 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:07:20,284 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 14:07:20,286 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 14:07:20,339 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:20,339 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:20,339 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:20,339 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:20,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 829 msec 2023-07-22 14:07:20,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 14:07:20,659 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 14:07:20,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e], force=true 2023-07-22 14:07:20,695 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e], force=true 2023-07-22 14:07:20,695 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e], force=true 2023-07-22 14:07:20,695 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e], force=true 2023-07-22 14:07:20,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 14:07:20,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, UNASSIGN}] 2023-07-22 14:07:20,718 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, UNASSIGN 2023-07-22 14:07:20,719 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, UNASSIGN 2023-07-22 14:07:20,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=db132b65b0c79037822f000df7d94f6e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:20,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1a17ebd6c151d9cb4686f2c2b8b184e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:20,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034840719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034840719"}]},"ts":"1690034840719"} 2023-07-22 14:07:20,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034840719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034840719"}]},"ts":"1690034840719"} 2023-07-22 14:07:20,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure db132b65b0c79037822f000df7d94f6e, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:20,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 1a17ebd6c151d9cb4686f2c2b8b184e8, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:20,733 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 14:07:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 14:07:20,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db132b65b0c79037822f000df7d94f6e, disabling compactions & flushes 2023-07-22 14:07:20,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. after waiting 0 ms 2023-07-22 14:07:20,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing db132b65b0c79037822f000df7d94f6e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 14:07:20,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a17ebd6c151d9cb4686f2c2b8b184e8, disabling compactions & flushes 2023-07-22 14:07:20,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. after waiting 0 ms 2023-07-22 14:07:20,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1a17ebd6c151d9cb4686f2c2b8b184e8 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 14:07:20,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/.tmp/cf/e0d76d904c964dea9c3c032a442084b1 2023-07-22 14:07:20,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/.tmp/cf/e0d76d904c964dea9c3c032a442084b1 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1 2023-07-22 14:07:20,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/.tmp/cf/57089d1c07a2490eaac161f28d17ce30 2023-07-22 14:07:20,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 14:07:20,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for db132b65b0c79037822f000df7d94f6e in 53ms, sequenceid=5, compaction requested=false 2023-07-22 14:07:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/.tmp/cf/57089d1c07a2490eaac161f28d17ce30 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30 2023-07-22 14:07:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 14:07:20,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:20,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e. 2023-07-22 14:07:20,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db132b65b0c79037822f000df7d94f6e: 2023-07-22 14:07:20,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 14:07:20,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:20,946 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=db132b65b0c79037822f000df7d94f6e, regionState=CLOSED 2023-07-22 14:07:20,946 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034840946"}]},"ts":"1690034840946"} 2023-07-22 14:07:20,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1a17ebd6c151d9cb4686f2c2b8b184e8 in 70ms, sequenceid=5, compaction requested=false 2023-07-22 14:07:20,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-22 14:07:20,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure db132b65b0c79037822f000df7d94f6e, server=jenkins-hbase4.apache.org,39735,1690034759682 in 231 msec 2023-07-22 14:07:20,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=db132b65b0c79037822f000df7d94f6e, UNASSIGN in 242 msec 2023-07-22 14:07:20,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 14:07:20,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:20,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8. 2023-07-22 14:07:20,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a17ebd6c151d9cb4686f2c2b8b184e8: 2023-07-22 14:07:20,973 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0004_000001 (auth:SIMPLE) 2023-07-22 14:07:20,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:20,974 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1a17ebd6c151d9cb4686f2c2b8b184e8, regionState=CLOSED 2023-07-22 14:07:20,974 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690034840974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034840974"}]},"ts":"1690034840974"} 2023-07-22 14:07:20,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-22 14:07:20,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 1a17ebd6c151d9cb4686f2c2b8b184e8, server=jenkins-hbase4.apache.org,45699,1690034759741 in 255 msec 2023-07-22 14:07:20,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-22 14:07:20,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a17ebd6c151d9cb4686f2c2b8b184e8, UNASSIGN in 270 msec 2023-07-22 14:07:20,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 14:07:21,054 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 14:07:21,056 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839545.1a17ebd6c151d9cb4686f2c2b8b184e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:21,056 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690034839545.db132b65b0c79037822f000df7d94f6e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:21,056 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:21,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, ASSIGN}] 2023-07-22 14:07:21,142 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, ASSIGN 2023-07-22 14:07:21,142 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:07:21,293 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 14:07:21,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c7385f2f047e7bf449fb9b588f8517a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690034841295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034841295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034841295"}]},"ts":"1690034841295"} 2023-07-22 14:07:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 14:07:21,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c7385f2f047e7bf449fb9b588f8517a4, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:21,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:21,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7385f2f047e7bf449fb9b588f8517a4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.', STARTKEY => '', ENDKEY => ''} 2023-07-22 14:07:21,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. service=AccessControlService 2023-07-22 14:07:21,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:21,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:21,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/.regioninfo 2023-07-22 14:07:21,472 INFO [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,473 DEBUG [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf 2023-07-22 14:07:21,473 DEBUG [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf 2023-07-22 14:07:21,474 INFO [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7385f2f047e7bf449fb9b588f8517a4 columnFamilyName cf 2023-07-22 14:07:21,509 DEBUG [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] regionserver.HStore(539): loaded hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/57089d1c07a2490eaac161f28d17ce30.1a17ebd6c151d9cb4686f2c2b8b184e8->hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30-top 2023-07-22 14:07:21,522 DEBUG [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] regionserver.HStore(539): loaded hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/e0d76d904c964dea9c3c032a442084b1.db132b65b0c79037822f000df7d94f6e->hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1-top 2023-07-22 14:07:21,523 INFO [StoreOpener-c7385f2f047e7bf449fb9b588f8517a4-1] regionserver.HStore(310): Store=c7385f2f047e7bf449fb9b588f8517a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:21,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:21,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7385f2f047e7bf449fb9b588f8517a4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73207592, jitterRate=0.09087812900543213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:21,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7385f2f047e7bf449fb9b588f8517a4: 2023-07-22 14:07:21,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4., pid=77, masterSystemTime=1690034841453 2023-07-22 14:07:21,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.,because compaction is disabled. 2023-07-22 14:07:21,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:21,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:21,536 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c7385f2f047e7bf449fb9b588f8517a4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,536 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690034841536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034841536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034841536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034841536"}]},"ts":"1690034841536"} 2023-07-22 14:07:21,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 14:07:21,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c7385f2f047e7bf449fb9b588f8517a4, server=jenkins-hbase4.apache.org,45699,1690034759741 in 236 msec 2023-07-22 14:07:21,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 14:07:21,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, ASSIGN in 399 msec 2023-07-22 14:07:21,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a17ebd6c151d9cb4686f2c2b8b184e8, db132b65b0c79037822f000df7d94f6e], force=true in 856 msec 2023-07-22 14:07:21,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 14:07:21,802 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 14:07:21,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 14:07:21,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034841802 (current time:1690034841802). 2023-07-22 14:07:21,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:21,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x70170469 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:21,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74086f44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:21,815 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:21,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70170469 to 127.0.0.1:59777 2023-07-22 14:07:21,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:21,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x659366b0 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:21,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d6f1227, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:21,824 DEBUG [hconnection-0x1a2a3a81-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:21,827 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:21,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:21,833 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:21,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659366b0 to 127.0.0.1:59777 2023-07-22 14:07:21,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:21,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 14:07:21,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:21,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 14:07:21,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 14:07:21,844 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 14:07:21,845 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690035441845 2023-07-22 14:07:21,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 14:07:21,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,850 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:21,850 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:21,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 14:07:21,851 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 14:07:21,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-22 14:07:21,854 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 14:07:21,855 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690035441855 2023-07-22 14:07:21,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,869 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 14:07:21,869 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:21,870 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 14:07:21,870 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 14:07:21,871 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,871 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,872 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,872 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,872 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,872 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,873 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,873 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:21,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 14:07:21,875 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:21,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 14:07:21,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 14:07:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 14:07:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 14:07:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 14:07:21,878 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:21,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 14:07:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:21,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 14:07:21,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35bc2e1c[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:21,880 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 14:07:21,880 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,883 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 14:07:21,884 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,884 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:21,888 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:21,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,888 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. started... 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 14:07:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 14:07:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 14:07:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 14:07:21,897 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7385f2f047e7bf449fb9b588f8517a4: 2023-07-22 14:07:21,897 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,897 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:21,898 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/57089d1c07a2490eaac161f28d17ce30.1a17ebd6c151d9cb4686f2c2b8b184e8->hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30-top, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/e0d76d904c964dea9c3c032a442084b1.db132b65b0c79037822f000df7d94f6e->hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1-top] hfiles 2023-07-22 14:07:21,898 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/57089d1c07a2490eaac161f28d17ce30.1a17ebd6c151d9cb4686f2c2b8b184e8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,898 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/e0d76d904c964dea9c3c032a442084b1.db132b65b0c79037822f000df7d94f6e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 14:07:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:21,902 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 14:07:21,902 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:21,902 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 14:07:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 14:07:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:21,904 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 14:07:21,913 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. completed. 2023-07-22 14:07:21,913 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 14:07:21,913 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:21,920 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 14:07:21,920 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:21,920 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,920 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 14:07:21,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:21,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:21,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:21,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:21,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 14:07:21,923 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 14:07:21,923 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:21,924 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:21,924 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,924 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:21,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:21,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,926 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,927 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,927 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:21,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,927 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,928 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:21,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,930 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:21,930 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,930 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:21,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:21,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,934 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:21,935 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,936 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:21,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:21,950 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:21,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 14:07:21,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:21,951 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:21,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 14:07:21,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,999 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:21,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690034841845Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690034841935 (+90 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690034841935Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690034841939 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690034841958 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690034841998 (+40 ms) 2023-07-22 14:07:22,001 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 14:07:22,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 153 msec 2023-07-22 14:07:22,151 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:22,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 14:07:22,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:22,153 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153 2023-07-22 14:07:22,153 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42431, tgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153, rawTgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:22,174 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:22,174 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1402528935_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:22,175 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 14:07:22,183 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:22,212 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,212 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,213 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,213 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,214 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,214 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,214 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,284 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-5635234453010944901.jar 2023-07-22 14:07:22,285 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,285 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,286 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,286 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,286 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,287 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:22,287 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:07:22,288 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:07:22,288 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:07:22,288 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:07:22,289 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:07:22,289 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:07:22,290 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:07:22,290 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:07:22,290 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:07:22,291 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:07:22,291 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:22,291 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:22,292 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:22,292 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:22,292 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:22,293 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:22,293 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:22,643 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:07:24,043 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:07:24,047 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 14:07:24,053 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 14:07:24,146 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:24,146 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:24,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0005_000001 (auth:SIMPLE) 2023-07-22 14:07:30,054 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0005_000001 (auth:SIMPLE) 2023-07-22 14:07:32,367 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0005_000001 (auth:SIMPLE) 2023-07-22 14:07:36,538 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0005_000001 (auth:SIMPLE) 2023-07-22 14:07:38,593 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:07:38,601 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:07:38,672 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,672 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:07:38,673 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:07:38,673 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,674 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 14:07:38,674 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 14:07:38,674 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,674 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 14:07:38,674 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034842153/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 14:07:38,681 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,688 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034858688"}]},"ts":"1690034858688"} 2023-07-22 14:07:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 14:07:38,689 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 14:07:38,691 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 14:07:38,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, UNASSIGN}] 2023-07-22 14:07:38,692 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, UNASSIGN 2023-07-22 14:07:38,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c7385f2f047e7bf449fb9b588f8517a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:38,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690034858693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034858693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034858693"}]},"ts":"1690034858693"} 2023-07-22 14:07:38,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c7385f2f047e7bf449fb9b588f8517a4, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:38,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 14:07:38,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7385f2f047e7bf449fb9b588f8517a4, disabling compactions & flushes 2023-07-22 14:07:38,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. after waiting 0 ms 2023-07-22 14:07:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:38,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 14:07:38,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:38,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4. 2023-07-22 14:07:38,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7385f2f047e7bf449fb9b588f8517a4: 2023-07-22 14:07:38,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:38,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c7385f2f047e7bf449fb9b588f8517a4, regionState=CLOSED 2023-07-22 14:07:38,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690034858886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034858886"}]},"ts":"1690034858886"} 2023-07-22 14:07:38,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 14:07:38,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c7385f2f047e7bf449fb9b588f8517a4, server=jenkins-hbase4.apache.org,45699,1690034759741 in 195 msec 2023-07-22 14:07:38,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 14:07:38,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c7385f2f047e7bf449fb9b588f8517a4, UNASSIGN in 203 msec 2023-07-22 14:07:38,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034858899"}]},"ts":"1690034858899"} 2023-07-22 14:07:38,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 14:07:38,903 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 14:07:38,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 222 msec 2023-07-22 14:07:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 14:07:38,991 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 14:07:38,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,998 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:38,999 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,003 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,003 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,003 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,003 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,005 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,005 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,005 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 14:07:39,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 14:07:39,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 14:07:39,006 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:07:39,005 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:07:39,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 14:07:39,005 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:07:39,005 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,006 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 14:07:39,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:39,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:39,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:39,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:39,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 14:07:39,015 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:39,018 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:39,018 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:39,024 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/recovered.edits] 2023-07-22 14:07:39,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/recovered.edits] 2023-07-22 14:07:39,042 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/recovered.edits] 2023-07-22 14:07:39,052 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/57089d1c07a2490eaac161f28d17ce30.1a17ebd6c151d9cb4686f2c2b8b184e8 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/57089d1c07a2490eaac161f28d17ce30.1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:39,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/cf/e0d76d904c964dea9c3c032a442084b1 2023-07-22 14:07:39,057 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/e0d76d904c964dea9c3c032a442084b1.db132b65b0c79037822f000df7d94f6e to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/cf/e0d76d904c964dea9c3c032a442084b1.db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:39,057 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/cf/57089d1c07a2490eaac161f28d17ce30 2023-07-22 14:07:39,065 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/recovered.edits/8.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e/recovered.edits/8.seqid 2023-07-22 14:07:39,065 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/db132b65b0c79037822f000df7d94f6e 2023-07-22 14:07:39,066 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/recovered.edits/8.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8/recovered.edits/8.seqid 2023-07-22 14:07:39,066 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/recovered.edits/12.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4/recovered.edits/12.seqid 2023-07-22 14:07:39,067 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a17ebd6c151d9cb4686f2c2b8b184e8 2023-07-22 14:07:39,067 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c7385f2f047e7bf449fb9b588f8517a4 2023-07-22 14:07:39,067 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 14:07:39,076 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,083 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 14:07:39,088 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 14:07:39,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 14:07:39,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034859090"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:39,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 14:07:39,105 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c7385f2f047e7bf449fb9b588f8517a4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690034839546.c7385f2f047e7bf449fb9b588f8517a4.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 14:07:39,105 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 14:07:39,105 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034859105"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:39,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 14:07:39,115 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 14:07:39,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 125 msec 2023-07-22 14:07:39,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 14:07:39,311 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 14:07:39,312 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 14:07:39,320 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034859319"}]},"ts":"1690034859319"} 2023-07-22 14:07:39,321 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 14:07:39,323 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 14:07:39,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, UNASSIGN}] 2023-07-22 14:07:39,327 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, UNASSIGN 2023-07-22 14:07:39,327 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, UNASSIGN 2023-07-22 14:07:39,329 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b046d70e901b54cd459852228a2b4b3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:39,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c826fa4f095b82c7b7522c1fd5e3f1ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:39,329 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034859329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034859329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034859329"}]},"ts":"1690034859329"} 2023-07-22 14:07:39,329 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034859329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034859329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034859329"}]},"ts":"1690034859329"} 2023-07-22 14:07:39,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure c826fa4f095b82c7b7522c1fd5e3f1ea, server=jenkins-hbase4.apache.org,45383,1690034759616}] 2023-07-22 14:07:39,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 0b046d70e901b54cd459852228a2b4b3, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:39,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 14:07:39,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b046d70e901b54cd459852228a2b4b3, disabling compactions & flushes 2023-07-22 14:07:39,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:39,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:39,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. after waiting 0 ms 2023-07-22 14:07:39,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:39,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c826fa4f095b82c7b7522c1fd5e3f1ea, disabling compactions & flushes 2023-07-22 14:07:39,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. after waiting 0 ms 2023-07-22 14:07:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:39,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:39,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:39,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:39,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:39,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea. 2023-07-22 14:07:39,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3. 2023-07-22 14:07:39,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b046d70e901b54cd459852228a2b4b3: 2023-07-22 14:07:39,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c826fa4f095b82c7b7522c1fd5e3f1ea: 2023-07-22 14:07:39,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:39,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b046d70e901b54cd459852228a2b4b3, regionState=CLOSED 2023-07-22 14:07:39,547 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034859547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034859547"}]},"ts":"1690034859547"} 2023-07-22 14:07:39,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:39,548 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c826fa4f095b82c7b7522c1fd5e3f1ea, regionState=CLOSED 2023-07-22 14:07:39,548 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690034859548"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034859548"}]},"ts":"1690034859548"} 2023-07-22 14:07:39,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-22 14:07:39,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 0b046d70e901b54cd459852228a2b4b3, server=jenkins-hbase4.apache.org,45699,1690034759741 in 216 msec 2023-07-22 14:07:39,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-22 14:07:39,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure c826fa4f095b82c7b7522c1fd5e3f1ea, server=jenkins-hbase4.apache.org,45383,1690034759616 in 217 msec 2023-07-22 14:07:39,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b046d70e901b54cd459852228a2b4b3, UNASSIGN in 228 msec 2023-07-22 14:07:39,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-22 14:07:39,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c826fa4f095b82c7b7522c1fd5e3f1ea, UNASSIGN in 228 msec 2023-07-22 14:07:39,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034859556"}]},"ts":"1690034859556"} 2023-07-22 14:07:39,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 14:07:39,560 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 14:07:39,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 249 msec 2023-07-22 14:07:39,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 14:07:39,621 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 14:07:39,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,626 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,627 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,628 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,631 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,631 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,631 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 14:07:39,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 14:07:39,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 14:07:39,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:39,633 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:39,634 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 14:07:39,635 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/recovered.edits] 2023-07-22 14:07:39,635 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/recovered.edits] 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,636 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:39,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 14:07:39,642 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/cf/642e79a6c3254bae91b19f42321abaa5 2023-07-22 14:07:39,642 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894 to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/cf/1ca6ca56cbf3434a9df5b3804ee5a894 2023-07-22 14:07:39,646 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea/recovered.edits/9.seqid 2023-07-22 14:07:39,647 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c826fa4f095b82c7b7522c1fd5e3f1ea 2023-07-22 14:07:39,647 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3/recovered.edits/9.seqid 2023-07-22 14:07:39,648 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b046d70e901b54cd459852228a2b4b3 2023-07-22 14:07:39,648 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 14:07:39,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,657 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 14:07:39,661 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 14:07:39,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 14:07:39,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034859662"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:39,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034859662"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:39,664 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:07:39,664 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b046d70e901b54cd459852228a2b4b3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690034837376.0b046d70e901b54cd459852228a2b4b3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c826fa4f095b82c7b7522c1fd5e3f1ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690034837376.c826fa4f095b82c7b7522c1fd5e3f1ea.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:07:39,664 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 14:07:39,665 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034859664"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:39,666 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 14:07:39,669 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-22 14:07:39,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 14:07:39,739 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 14:07:39,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 14:07:39,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,757 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 14:07:39,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 14:07:39,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 14:07:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 14:07:39,800 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 749) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4064 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-499621146_1 at /127.0.0.1:58378 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:58398 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-499621146_1 at /127.0.0.1:39186 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:39533 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:39212 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=712 (was 355) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=5902 (was 6655) 2023-07-22 14:07:39,800 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 14:07:39,833 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=712, ProcessCount=186, AvailableMemoryMB=5899 2023-07-22 14:07:39,834 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 14:07:39,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:07:39,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:39,848 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:07:39,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 14:07:39,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:07:39,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 14:07:39,854 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:39,854 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:39,855 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 empty. 2023-07-22 14:07:39,855 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 empty. 2023-07-22 14:07:39,855 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:39,855 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:39,855 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 14:07:39,886 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 14:07:39,899 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b485f17853e1e3add1ef610a36b9d4c9, NAME => 'testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:39,900 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 862e96172f83d990389f789278057196, NAME => 'testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:39,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 14:07:39,976 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:39,980 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b485f17853e1e3add1ef610a36b9d4c9, disabling compactions & flushes 2023-07-22 14:07:39,980 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:39,980 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:39,980 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. after waiting 0 ms 2023-07-22 14:07:39,980 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:39,980 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:39,980 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b485f17853e1e3add1ef610a36b9d4c9: 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 862e96172f83d990389f789278057196, disabling compactions & flushes 2023-07-22 14:07:39,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. after waiting 0 ms 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:39,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:39,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 862e96172f83d990389f789278057196: 2023-07-22 14:07:39,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:07:39,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034859988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034859988"}]},"ts":"1690034859988"} 2023-07-22 14:07:39,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034859988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034859988"}]},"ts":"1690034859988"} 2023-07-22 14:07:39,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:07:39,991 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:07:39,992 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034859991"}]},"ts":"1690034859991"} 2023-07-22 14:07:39,993 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 14:07:39,997 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:07:40,000 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:07:40,000 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:07:40,000 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:07:40,000 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:07:40,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, ASSIGN}] 2023-07-22 14:07:40,004 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, ASSIGN 2023-07-22 14:07:40,004 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, ASSIGN 2023-07-22 14:07:40,007 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:07:40,007 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:07:40,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 14:07:40,158 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:07:40,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=862e96172f83d990389f789278057196, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b485f17853e1e3add1ef610a36b9d4c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034860161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034860161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034860161"}]},"ts":"1690034860161"} 2023-07-22 14:07:40,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034860161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034860161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034860161"}]},"ts":"1690034860161"} 2023-07-22 14:07:40,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 862e96172f83d990389f789278057196, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:40,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure b485f17853e1e3add1ef610a36b9d4c9, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:40,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b485f17853e1e3add1ef610a36b9d4c9, NAME => 'testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:07:40,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. service=AccessControlService 2023-07-22 14:07:40,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:40,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:40,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:40,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 862e96172f83d990389f789278057196, NAME => 'testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:07:40,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. service=AccessControlService 2023-07-22 14:07:40,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:40,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 862e96172f83d990389f789278057196 2023-07-22 14:07:40,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:40,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 862e96172f83d990389f789278057196 2023-07-22 14:07:40,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 862e96172f83d990389f789278057196 2023-07-22 14:07:40,341 INFO [StoreOpener-b485f17853e1e3add1ef610a36b9d4c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,351 INFO [StoreOpener-862e96172f83d990389f789278057196-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 862e96172f83d990389f789278057196 2023-07-22 14:07:40,353 DEBUG [StoreOpener-b485f17853e1e3add1ef610a36b9d4c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf 2023-07-22 14:07:40,353 DEBUG [StoreOpener-b485f17853e1e3add1ef610a36b9d4c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf 2023-07-22 14:07:40,355 INFO [StoreOpener-b485f17853e1e3add1ef610a36b9d4c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b485f17853e1e3add1ef610a36b9d4c9 columnFamilyName cf 2023-07-22 14:07:40,357 INFO [StoreOpener-b485f17853e1e3add1ef610a36b9d4c9-1] regionserver.HStore(310): Store=b485f17853e1e3add1ef610a36b9d4c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:40,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,359 DEBUG [StoreOpener-862e96172f83d990389f789278057196-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf 2023-07-22 14:07:40,359 DEBUG [StoreOpener-862e96172f83d990389f789278057196-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf 2023-07-22 14:07:40,360 INFO [StoreOpener-862e96172f83d990389f789278057196-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862e96172f83d990389f789278057196 columnFamilyName cf 2023-07-22 14:07:40,360 INFO [StoreOpener-862e96172f83d990389f789278057196-1] regionserver.HStore(310): Store=862e96172f83d990389f789278057196/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:40,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:40,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:40,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:40,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:40,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b485f17853e1e3add1ef610a36b9d4c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59063925, jitterRate=-0.11987893283367157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:40,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 862e96172f83d990389f789278057196 2023-07-22 14:07:40,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b485f17853e1e3add1ef610a36b9d4c9: 2023-07-22 14:07:40,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9., pid=94, masterSystemTime=1690034860324 2023-07-22 14:07:40,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,368 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b485f17853e1e3add1ef610a36b9d4c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,368 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034860368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034860368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034860368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034860368"}]},"ts":"1690034860368"} 2023-07-22 14:07:40,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:40,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 862e96172f83d990389f789278057196; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64613762, jitterRate=-0.037179917097091675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:40,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 862e96172f83d990389f789278057196: 2023-07-22 14:07:40,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196., pid=93, masterSystemTime=1690034860316 2023-07-22 14:07:40,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:40,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:40,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=862e96172f83d990389f789278057196, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034860387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034860387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034860387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034860387"}]},"ts":"1690034860387"} 2023-07-22 14:07:40,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-22 14:07:40,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure b485f17853e1e3add1ef610a36b9d4c9, server=jenkins-hbase4.apache.org,45699,1690034759741 in 213 msec 2023-07-22 14:07:40,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, ASSIGN in 387 msec 2023-07-22 14:07:40,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-22 14:07:40,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 862e96172f83d990389f789278057196, server=jenkins-hbase4.apache.org,39735,1690034759682 in 225 msec 2023-07-22 14:07:40,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-22 14:07:40,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, ASSIGN in 391 msec 2023-07-22 14:07:40,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:07:40,396 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034860396"}]},"ts":"1690034860396"} 2023-07-22 14:07:40,397 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 14:07:40,405 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:07:40,406 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 14:07:40,408 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:07:40,409 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:40,409 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:40,409 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:40,409 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:40,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:40,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:40,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:40,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:40,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 576 msec 2023-07-22 14:07:40,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 14:07:40,455 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 14:07:40,455 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 14:07:40,455 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:40,461 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 14:07:40,461 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:40,461 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-22 14:07:40,469 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034860469 (current time:1690034860469). 2023-07-22 14:07:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:40,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x5c902ae4 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:40,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc03d10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:40,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,504 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c902ae4 to 127.0.0.1:59777 2023-07-22 14:07:40,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:40,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x472bc661 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:40,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ab1036a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:40,578 DEBUG [hconnection-0x47c49591-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,583 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,591 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472bc661 to 127.0.0.1:59777 2023-07-22 14:07:40,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:40,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:07:40,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:40,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,598 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,599 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690035460598 2023-07-22 14:07:40,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 14:07:40,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,601 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:40,602 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:40,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:40,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-22 14:07:40,608 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:40,609 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690035460609 2023-07-22 14:07:40,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,632 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 14:07:40,632 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:40,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 14:07:40,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 14:07:40,702 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:40,703 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,703 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:07:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:40,704 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:40,707 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,707 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,707 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,708 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,708 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:40,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:40,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:40,713 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:40,714 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:40,715 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,715 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:40,720 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:40,721 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,721 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,721 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:40,721 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:40,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 14:07:40,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@454add4f[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:40,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 14:07:40,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@454add4f[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:40,725 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 14:07:40,725 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:40,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:40,727 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,727 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:40,728 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,728 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:40,728 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. started... 2023-07-22 14:07:40,728 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,728 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:40,733 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b485f17853e1e3add1ef610a36b9d4c9: 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. started... 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:40,735 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:40,737 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 862e96172f83d990389f789278057196: 2023-07-22 14:07:40,737 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,737 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:40,737 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:40,761 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. completed. 2023-07-22 14:07:40,761 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:40,761 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:40,762 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:40,762 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,762 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:40,762 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:40,763 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. completed. 2023-07-22 14:07:40,763 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:40,763 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,763 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:40,764 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:40,767 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:40,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:40,767 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:40,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:40,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:40,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:40,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:40,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:40,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 14:07:40,775 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 14:07:40,775 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:40,775 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:40,775 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,775 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:40,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,777 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,777 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,778 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:40,778 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:40,780 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,780 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,780 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,783 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,783 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,784 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,784 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:40,784 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,783 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:40,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:40,785 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:40,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,790 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:40,790 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,791 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 14:07:40,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,857 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:40,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690034860599Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690034860786 (+187 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690034860786Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690034860790 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690034860810 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690034860856 (+46 ms) 2023-07-22 14:07:40,861 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:40,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 261 msec 2023-07-22 14:07:40,904 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:40,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:07:40,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:40,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:40,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39735] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:40,930 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 14:07:40,930 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:40,931 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:40,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034860950 (current time:1690034860950). 2023-07-22 14:07:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x02efad18 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:40,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61e4c8c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,970 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02efad18 to 127.0.0.1:59777 2023-07-22 14:07:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x764e1d8f to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:40,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@936e933, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:40,981 DEBUG [hconnection-0x4e53ca5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,982 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:40,987 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:40,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x764e1d8f to 127.0.0.1:59777 2023-07-22 14:07:40,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:40,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 14:07:40,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:40,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,992 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,993 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690035460993 2023-07-22 14:07:40,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 14:07:40,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 14:07:40,995 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:40,995 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:40,996 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 14:07:40,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:40,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-22 14:07:40,997 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:40,998 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690035460998 2023-07-22 14:07:41,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,016 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 14:07:41,016 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:41,018 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 14:07:41,018 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 14:07:41,019 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,019 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,020 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,020 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,020 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,020 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,021 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,021 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,021 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,021 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 14:07:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:41,022 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:41,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:41,025 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 14:07:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:41,029 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 14:07:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:41,030 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 14:07:41,032 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,032 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:41,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:41,032 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,032 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,033 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,033 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:41,035 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:41,035 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:41,035 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,035 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:41,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f80d47[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:41,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:41,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 14:07:41,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f80d47[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:41,040 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 14:07:41,040 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:41,045 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,045 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:41,046 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:41,045 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:41,046 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. started... 2023-07-22 14:07:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:41,046 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. started... 2023-07-22 14:07:41,046 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 862e96172f83d990389f789278057196 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-22 14:07:41,046 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b485f17853e1e3add1ef610a36b9d4c9 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-22 14:07:41,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:41,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:41,048 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:41,061 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/.tmp/cf/f91adc2e708c46ed8a2683f4cd63165c 2023-07-22 14:07:41,065 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/.tmp/cf/d10af6b9087141b0bb3989d28d3ba48b 2023-07-22 14:07:41,068 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/.tmp/cf/f91adc2e708c46ed8a2683f4cd63165c as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c 2023-07-22 14:07:41,070 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/.tmp/cf/d10af6b9087141b0bb3989d28d3ba48b as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b 2023-07-22 14:07:41,073 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c, entries=6, sequenceid=6, filesize=5.2 K 2023-07-22 14:07:41,076 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for b485f17853e1e3add1ef610a36b9d4c9 in 29ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b485f17853e1e3add1ef610a36b9d4c9: 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c] hfiles 2023-07-22 14:07:41,076 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,078 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b, entries=44, sequenceid=6, filesize=7.8 K 2023-07-22 14:07:41,078 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 862e96172f83d990389f789278057196 in 32ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:41,080 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 862e96172f83d990389f789278057196: 2023-07-22 14:07:41,080 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,080 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:41,080 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b] hfiles 2023-07-22 14:07:41,080 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,092 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. completed. 2023-07-22 14:07:41,092 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:41,094 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,094 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:41,095 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:41,094 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:41,095 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. completed. 2023-07-22 14:07:41,098 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:41,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 14:07:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:41,095 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:07:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:41,099 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 14:07:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:41,100 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,100 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 14:07:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:07:41,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 14:07:41,109 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 14:07:41,109 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:41,109 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:41,109 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,109 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:41,110 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,110 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,110 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,111 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:41,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,113 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:41,113 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,114 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,116 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,116 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,116 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,121 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,122 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:41,126 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:41,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 14:07:41,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,215 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690034860993Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690034861128 (+135 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690034861129 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690034861134 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690034861155 (+21 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690034861214 (+59 ms) 2023-07-22 14:07:41,222 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 14:07:41,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 228 msec 2023-07-22 14:07:41,299 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:41,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 14:07:41,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:41,300 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300 2023-07-22 14:07:41,301 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42431, tgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300, rawTgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:41,325 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:41,325 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1325681662_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,325 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 14:07:41,330 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:41,351 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,352 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,352 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,352 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,353 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,353 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,353 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,425 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-5342629396323939114.jar 2023-07-22 14:07:41,425 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,426 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,426 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,426 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,426 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,427 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:41,427 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:07:41,428 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:07:41,429 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:07:41,429 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:07:41,430 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:07:41,430 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:07:41,431 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:07:41,431 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:07:41,432 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:07:41,433 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:07:41,433 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:41,434 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:41,434 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:41,435 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:41,435 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:41,435 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:41,436 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:41,932 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:07:41,935 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 14:07:42,744 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:42,745 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:42,748 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0005_000001 (auth:SIMPLE) 2023-07-22 14:07:42,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0006_000001 (auth:SIMPLE) 2023-07-22 14:07:44,525 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:07:48,877 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0006_000001 (auth:SIMPLE) 2023-07-22 14:07:51,364 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:07:51,365 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:07:51,377 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:51,377 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:07:51,378 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:07:51,378 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:51,379 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 14:07:51,379 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 14:07:51,379 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:51,379 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 14:07:51,379 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034861300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 14:07:51,385 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 14:07:51,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034871393"}]},"ts":"1690034871393"} 2023-07-22 14:07:51,394 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 14:07:51,398 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 14:07:51,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, UNASSIGN}] 2023-07-22 14:07:51,405 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, UNASSIGN 2023-07-22 14:07:51,405 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, UNASSIGN 2023-07-22 14:07:51,406 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b485f17853e1e3add1ef610a36b9d4c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:51,406 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=862e96172f83d990389f789278057196, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:51,406 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034871406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034871406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034871406"}]},"ts":"1690034871406"} 2023-07-22 14:07:51,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034871406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034871406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034871406"}]},"ts":"1690034871406"} 2023-07-22 14:07:51,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure b485f17853e1e3add1ef610a36b9d4c9, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:51,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 862e96172f83d990389f789278057196, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:51,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 14:07:51,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 862e96172f83d990389f789278057196 2023-07-22 14:07:51,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 862e96172f83d990389f789278057196, disabling compactions & flushes 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b485f17853e1e3add1ef610a36b9d4c9, disabling compactions & flushes 2023-07-22 14:07:51,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. after waiting 0 ms 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:51,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. after waiting 0 ms 2023-07-22 14:07:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:51,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:51,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:07:51,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:51,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9. 2023-07-22 14:07:51,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:07:51,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b485f17853e1e3add1ef610a36b9d4c9: 2023-07-22 14:07:51,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196. 2023-07-22 14:07:51,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 862e96172f83d990389f789278057196: 2023-07-22 14:07:51,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:51,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b485f17853e1e3add1ef610a36b9d4c9, regionState=CLOSED 2023-07-22 14:07:51,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034871600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034871600"}]},"ts":"1690034871600"} 2023-07-22 14:07:51,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 862e96172f83d990389f789278057196 2023-07-22 14:07:51,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=862e96172f83d990389f789278057196, regionState=CLOSED 2023-07-22 14:07:51,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690034871601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034871601"}]},"ts":"1690034871601"} 2023-07-22 14:07:51,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-22 14:07:51,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure b485f17853e1e3add1ef610a36b9d4c9, server=jenkins-hbase4.apache.org,45699,1690034759741 in 197 msec 2023-07-22 14:07:51,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-22 14:07:51,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 862e96172f83d990389f789278057196, server=jenkins-hbase4.apache.org,39735,1690034759682 in 196 msec 2023-07-22 14:07:51,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b485f17853e1e3add1ef610a36b9d4c9, UNASSIGN in 210 msec 2023-07-22 14:07:51,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-22 14:07:51,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=862e96172f83d990389f789278057196, UNASSIGN in 211 msec 2023-07-22 14:07:51,613 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034871612"}]},"ts":"1690034871612"} 2023-07-22 14:07:51,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 14:07:51,618 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 14:07:51,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 232 msec 2023-07-22 14:07:51,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 14:07:51,696 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 14:07:51,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,701 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,702 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,703 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,707 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,707 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,708 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,708 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 14:07:51,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 14:07:51,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 14:07:51,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:51,709 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:51,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 14:07:51,713 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:51,713 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:51,716 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/recovered.edits] 2023-07-22 14:07:51,716 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/recovered.edits] 2023-07-22 14:07:51,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/cf/d10af6b9087141b0bb3989d28d3ba48b 2023-07-22 14:07:51,723 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/cf/f91adc2e708c46ed8a2683f4cd63165c 2023-07-22 14:07:51,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196/recovered.edits/9.seqid 2023-07-22 14:07:51,730 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/862e96172f83d990389f789278057196 2023-07-22 14:07:51,730 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9/recovered.edits/9.seqid 2023-07-22 14:07:51,740 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testEmptyExportFileSystemState/b485f17853e1e3add1ef610a36b9d4c9 2023-07-22 14:07:51,740 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 14:07:51,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,760 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 14:07:51,769 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 14:07:51,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 14:07:51,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034871771"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:51,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034871771"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:51,785 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:07:51,785 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b485f17853e1e3add1ef610a36b9d4c9, NAME => 'testtb-testEmptyExportFileSystemState,,1690034859836.b485f17853e1e3add1ef610a36b9d4c9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 862e96172f83d990389f789278057196, NAME => 'testtb-testEmptyExportFileSystemState,1,1690034859836.862e96172f83d990389f789278057196.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:07:51,785 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 14:07:51,785 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034871785"}]},"ts":"9223372036854775807"} 2023-07-22 14:07:51,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 14:07:51,798 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 14:07:51,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 101 msec 2023-07-22 14:07:51,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 14:07:51,813 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 14:07:51,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 14:07:51,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:51,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 14:07:51,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 14:07:51,888 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 762) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:33293 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:33489 from appattempt_1690034767394_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:55882 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:34446 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-410579031_1 at /127.0.0.1:50848 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-410579031_1 at /127.0.0.1:44740 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:36259 from appattempt_1690034767394_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4716 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:55620 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=760 (was 712) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 186), AvailableMemoryMB=5635 (was 5899) 2023-07-22 14:07:51,888 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-22 14:07:51,933 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=760, ProcessCount=182, AvailableMemoryMB=5633 2023-07-22 14:07:51,933 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-22 14:07:51,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 14:07:51,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:51,939 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 14:07:51,941 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 14:07:51,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 14:07:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 14:07:51,944 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:07:51,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:51,945 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c empty. 2023-07-22 14:07:51,945 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 empty. 2023-07-22 14:07:51,946 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:51,947 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:07:51,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 14:07:51,968 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 14:07:51,969 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6944870251b7fedec2db4c5769090420, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:51,972 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 18ce8e30c27f06bc89e8f43f0bda5c4c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6944870251b7fedec2db4c5769090420, disabling compactions & flushes 2023-07-22 14:07:52,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. after waiting 0 ms 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6944870251b7fedec2db4c5769090420: 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 18ce8e30c27f06bc89e8f43f0bda5c4c, disabling compactions & flushes 2023-07-22 14:07:52,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. after waiting 0 ms 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,025 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 18ce8e30c27f06bc89e8f43f0bda5c4c: 2023-07-22 14:07:52,028 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 14:07:52,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034872029"}]},"ts":"1690034872029"} 2023-07-22 14:07:52,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034872029"}]},"ts":"1690034872029"} 2023-07-22 14:07:52,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 14:07:52,037 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 14:07:52,038 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034872038"}]},"ts":"1690034872038"} 2023-07-22 14:07:52,039 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 14:07:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 14:07:52,046 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 14:07:52,048 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 14:07:52,048 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 14:07:52,048 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 14:07:52,048 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 14:07:52,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, ASSIGN}] 2023-07-22 14:07:52,052 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, ASSIGN 2023-07-22 14:07:52,052 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, ASSIGN 2023-07-22 14:07:52,055 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45699,1690034759741; forceNewPlan=false, retain=false 2023-07-22 14:07:52,055 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39735,1690034759682; forceNewPlan=false, retain=false 2023-07-22 14:07:52,209 INFO [jenkins-hbase4:36585] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 14:07:52,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6944870251b7fedec2db4c5769090420, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,212 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=18ce8e30c27f06bc89e8f43f0bda5c4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034872212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034872212"}]},"ts":"1690034872212"} 2023-07-22 14:07:52,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034872212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034872212"}]},"ts":"1690034872212"} 2023-07-22 14:07:52,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 6944870251b7fedec2db4c5769090420, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:07:52,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 18ce8e30c27f06bc89e8f43f0bda5c4c, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:07:52,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 14:07:52,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6944870251b7fedec2db4c5769090420, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 14:07:52,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. service=AccessControlService 2023-07-22 14:07:52,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:52,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:52,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18ce8e30c27f06bc89e8f43f0bda5c4c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 14:07:52,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. service=AccessControlService 2023-07-22 14:07:52,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 14:07:52,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 14:07:52,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,391 INFO [StoreOpener-6944870251b7fedec2db4c5769090420-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,391 INFO [StoreOpener-18ce8e30c27f06bc89e8f43f0bda5c4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,392 DEBUG [StoreOpener-6944870251b7fedec2db4c5769090420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf 2023-07-22 14:07:52,393 DEBUG [StoreOpener-6944870251b7fedec2db4c5769090420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf 2023-07-22 14:07:52,393 DEBUG [StoreOpener-18ce8e30c27f06bc89e8f43f0bda5c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf 2023-07-22 14:07:52,394 DEBUG [StoreOpener-18ce8e30c27f06bc89e8f43f0bda5c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf 2023-07-22 14:07:52,395 INFO [StoreOpener-18ce8e30c27f06bc89e8f43f0bda5c4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ce8e30c27f06bc89e8f43f0bda5c4c columnFamilyName cf 2023-07-22 14:07:52,395 INFO [StoreOpener-6944870251b7fedec2db4c5769090420-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6944870251b7fedec2db4c5769090420 columnFamilyName cf 2023-07-22 14:07:52,396 INFO [StoreOpener-6944870251b7fedec2db4c5769090420-1] regionserver.HStore(310): Store=6944870251b7fedec2db4c5769090420/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:52,396 INFO [StoreOpener-18ce8e30c27f06bc89e8f43f0bda5c4c-1] regionserver.HStore(310): Store=18ce8e30c27f06bc89e8f43f0bda5c4c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 14:07:52,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:07:52,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6944870251b7fedec2db4c5769090420 2023-07-22 14:07:52,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:52,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18ce8e30c27f06bc89e8f43f0bda5c4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69384804, jitterRate=0.033914148807525635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:52,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18ce8e30c27f06bc89e8f43f0bda5c4c: 2023-07-22 14:07:52,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c., pid=109, masterSystemTime=1690034872372 2023-07-22 14:07:52,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 14:07:52,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6944870251b7fedec2db4c5769090420; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64610520, jitterRate=-0.03722822666168213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 14:07:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6944870251b7fedec2db4c5769090420: 2023-07-22 14:07:52,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420., pid=108, masterSystemTime=1690034872369 2023-07-22 14:07:52,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=18ce8e30c27f06bc89e8f43f0bda5c4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034872418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034872418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034872418"}]},"ts":"1690034872418"} 2023-07-22 14:07:52,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6944870251b7fedec2db4c5769090420, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034872420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690034872420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690034872420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690034872420"}]},"ts":"1690034872420"} 2023-07-22 14:07:52,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 14:07:52,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 18ce8e30c27f06bc89e8f43f0bda5c4c, server=jenkins-hbase4.apache.org,39735,1690034759682 in 201 msec 2023-07-22 14:07:52,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, ASSIGN in 375 msec 2023-07-22 14:07:52,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 14:07:52,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 6944870251b7fedec2db4c5769090420, server=jenkins-hbase4.apache.org,45699,1690034759741 in 206 msec 2023-07-22 14:07:52,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-22 14:07:52,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, ASSIGN in 378 msec 2023-07-22 14:07:52,432 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 14:07:52,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034872432"}]},"ts":"1690034872432"} 2023-07-22 14:07:52,435 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 14:07:52,438 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 14:07:52,438 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 14:07:52,440 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 14:07:52,441 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:52,441 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:52,441 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:52,441 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:07:52,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:52,445 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:52,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:52,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 14:07:52,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 510 msec 2023-07-22 14:07:52,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 14:07:52,548 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 14:07:52,548 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-22 14:07:52,549 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:52,552 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-22 14:07:52,552 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:52,552 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-22 14:07:52,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:52,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034872555 (current time:1690034872555). 2023-07-22 14:07:52,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:52,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x25b9d662 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:52,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cac16c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:52,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:52,567 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:52,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25b9d662 to 127.0.0.1:59777 2023-07-22 14:07:52,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:52,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x06f3c701 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:52,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d921b7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:52,576 DEBUG [hconnection-0x2144425e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:52,578 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:52,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:52,585 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:52,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f3c701 to 127.0.0.1:59777 2023-07-22 14:07:52,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:52,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 14:07:52,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:52,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:52,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:52,590 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:52,592 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690035472592 2023-07-22 14:07:52,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:52,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,593 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:52,593 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:52,595 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:52,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:52,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-22 14:07:52,597 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:52,597 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690035472597 2023-07-22 14:07:52,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,630 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 14:07:52,630 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:52,631 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 14:07:52,631 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 14:07:52,632 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,632 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,633 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,633 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,634 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:52,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,639 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:52,639 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:52,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:52,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:52,640 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:52,641 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:52,642 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:52,642 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:52,643 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:52,643 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:52,642 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:52,648 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,648 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,650 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,650 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:52,651 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,651 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:52,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:52,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:52,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aec26f9[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:52,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:52,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:52,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 14:07:52,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aec26f9[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:52,655 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 14:07:52,655 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,656 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,656 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,656 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:52,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:52,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:52,657 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:52,657 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,658 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:52,658 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,658 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:52,658 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. started... 2023-07-22 14:07:52,658 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,658 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:52,658 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. started... 2023-07-22 14:07:52,660 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6944870251b7fedec2db4c5769090420: 2023-07-22 14:07:52,660 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ce8e30c27f06bc89e8f43f0bda5c4c: 2023-07-22 14:07:52,660 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:52,661 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,661 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:52,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:52,661 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:52,662 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:52,662 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 14:07:52,691 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. completed. 2023-07-22 14:07:52,691 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:52,691 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:52,691 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:52,691 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,691 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:52,691 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:52,694 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:52,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:52,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:52,697 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,697 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:52,697 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,697 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:52,698 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:52,698 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. completed. 2023-07-22 14:07:52,698 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:52,698 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:52,699 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:52,699 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:52,699 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:52,699 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,700 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,701 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:52,701 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:52,701 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:07:52,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 14:07:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:52,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 14:07:52,710 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 14:07:52,710 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:52,710 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:52,710 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,710 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:52,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,712 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:52,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,713 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,715 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,716 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:52,716 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:52,719 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,719 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,720 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:52,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,726 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:52,727 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:52,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,727 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-22 14:07:52,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:52,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:52,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,898 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:52,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:52,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:52,899 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 14:07:52,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 14:07:52,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,936 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:52,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690034872592Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690034872727 (+135 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690034872727Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690034872740 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690034872811 (+71 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690034872935 (+124 ms) 2023-07-22 14:07:52,940 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:52,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 347 msec 2023-07-22 14:07:53,200 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:53,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:53,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:53,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45699] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:53,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39735] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 14:07:53,251 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,251 DEBUG [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:53,252 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 14:07:53,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:53,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690034873284 (current time:1690034873284). 2023-07-22 14:07:53,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 14:07:53,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x09ddd3f6 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a883621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:53,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:53,301 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:53,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09ddd3f6 to 127.0.0.1:59777 2023-07-22 14:07:53,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:53,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(139): Connect 0x0a91f9e7 to 127.0.0.1:59777 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 14:07:53,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d34c920, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 14:07:53,320 DEBUG [hconnection-0x2646c399-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:53,325 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:53,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 14:07:53,334 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 14:07:53,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a91f9e7 to 127.0.0.1:59777 2023-07-22 14:07:53,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:07:53,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 14:07:53,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 14:07:53,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:53,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:53,345 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:53,351 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690035473351 2023-07-22 14:07:53,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 14:07:53,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,351 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 14:07:53,352 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 14:07:53,357 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 14:07:53,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:53,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 15 msec 2023-07-22 14:07:53,367 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:53,367 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690035473367 2023-07-22 14:07:53,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,442 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 14:07:53,442 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:53,444 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 14:07:53,445 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 14:07:53,445 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,445 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,447 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:53,447 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:53,447 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,447 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:53,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,449 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,449 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:53,450 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,450 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 14:07:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 14:07:53,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:53,452 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:53,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:53,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:53,454 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 14:07:53,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,463 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:53,463 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:53,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45383,1690034759616' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:53,473 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:53,472 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 14:07:53,477 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,480 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 14:07:53,480 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 14:07:53,480 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 14:07:53,483 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:53,483 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,483 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:53,484 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,486 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,487 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,487 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 14:07:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:53,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39735,1690034759682' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 14:07:53,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef43576[Count = 1] remaining members to acquire global barrier 2023-07-22 14:07:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:53,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45699,1690034759741' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 14:07:53,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef43576[Count = 0] remaining members to acquire global barrier 2023-07-22 14:07:53,493 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 14:07:53,493 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,498 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,498 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,498 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:53,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,499 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,499 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:53,499 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,499 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 14:07:53,500 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 14:07:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45383,1690034759616' in zk 2023-07-22 14:07:53,501 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,45383,1690034759616' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:53,509 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:53,509 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:53,509 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 14:07:53,510 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:53,510 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. started... 2023-07-22 14:07:53,509 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. started... 2023-07-22 14:07:53,510 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 14:07:53,512 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6944870251b7fedec2db4c5769090420 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-22 14:07:53,513 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18ce8e30c27f06bc89e8f43f0bda5c4c 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-22 14:07:53,599 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/.tmp/cf/d2dd8934e8e84f08bf5f2ad58b312d6d 2023-07-22 14:07:53,609 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/.tmp/cf/d2dd8934e8e84f08bf5f2ad58b312d6d as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d 2023-07-22 14:07:53,610 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/.tmp/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f 2023-07-22 14:07:53,625 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d, entries=49, sequenceid=6, filesize=8.1 K 2023-07-22 14:07:53,626 INFO [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 18ce8e30c27f06bc89e8f43f0bda5c4c in 114ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ce8e30c27f06bc89e8f43f0bda5c4c: 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d] hfiles 2023-07-22 14:07:53,627 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,628 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/.tmp/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f 2023-07-22 14:07:53,635 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f, entries=1, sequenceid=6, filesize=4.9 K 2023-07-22 14:07:53,636 INFO [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 6944870251b7fedec2db4c5769090420 in 124ms, sequenceid=6, compaction requested=false 2023-07-22 14:07:53,652 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6944870251b7fedec2db4c5769090420: 2023-07-22 14:07:53,652 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,652 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 14:07:53,652 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f] hfiles 2023-07-22 14:07:53,652 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,654 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:53,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:53,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:53,655 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 14:07:53,770 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. completed. 2023-07-22 14:07:53,771 DEBUG [rs(jenkins-hbase4.apache.org,45699,1690034759741)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:07:53,771 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:53,771 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:53,771 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,771 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:53,771 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45699,1690034759741' in zk 2023-07-22 14:07:53,774 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,774 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:53,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:53,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:53,774 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:53,775 DEBUG [member: 'jenkins-hbase4.apache.org,45699,1690034759741' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:53,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:53,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:53,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:53,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:53,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:53,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:53,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:53,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45699,1690034759741': 2023-07-22 14:07:53,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45699,1690034759741' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 14:07:53,955 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:53,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:53,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 14:07:53,957 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 14:07:54,128 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. completed. 2023-07-22 14:07:54,128 DEBUG [rs(jenkins-hbase4.apache.org,39735,1690034759682)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:07:54,128 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 14:07:54,128 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 14:07:54,128 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,128 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 14:07:54,129 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39735,1690034759682' in zk 2023-07-22 14:07:54,130 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 14:07:54,131 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,131 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:54,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:54,131 DEBUG [member: 'jenkins-hbase4.apache.org,39735,1690034759682' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 14:07:54,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:54,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:54,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39735,1690034759682': 2023-07-22 14:07:54,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39735,1690034759682' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 14:07:54,144 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 14:07:54,144 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 14:07:54,144 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 14:07:54,144 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,144 INFO [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,146 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 14:07:54,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,149 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,150 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 14:07:54,151 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 14:07:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,154 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,154 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,155 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:54,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:54,166 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 14:07:54,167 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 14:07:54,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 14:07:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 14:07:54,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 14:07:54,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 14:07:54,168 DEBUG [(jenkins-hbase4.apache.org,36585,1690034758169)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 14:07:54,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 14:07:54,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,407 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690034873351Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690034874170 (+819 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690034874170Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690034874192 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690034874315 (+123 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690034874406 (+91 ms) 2023-07-22 14:07:54,411 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 14:07:54,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.0560 sec 2023-07-22 14:07:54,457 DEBUG [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 14:07:54,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 14:07:54,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 14:07:54,459 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459 2023-07-22 14:07:54,459 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42431, tgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459, rawTgtDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459, srcFsUri=hdfs://localhost:42431, srcDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:54,488 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1 2023-07-22 14:07:54,488 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1407070666_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,488 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42431, inputRoot=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1, snapshotDir=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 14:07:54,503 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:07:54,588 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,589 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,590 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,590 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,591 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,591 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,591 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,687 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/hadoop-772008797241995209.jar 2023-07-22 14:07:54,687 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,688 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,688 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,689 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,689 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,689 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 14:07:54,690 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 14:07:54,690 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 14:07:54,691 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 14:07:54,691 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 14:07:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 14:07:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 14:07:54,692 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 14:07:54,693 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 14:07:54,693 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 14:07:54,694 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 14:07:54,694 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:54,695 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:54,695 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:54,695 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:54,696 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 14:07:54,696 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:54,697 DEBUG [Listener at jenkins-hbase4.apache.org/35687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 14:07:55,698 WARN [Listener at jenkins-hbase4.apache.org/35687] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 14:07:55,700 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 14:07:55,701 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 14:07:56,351 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:56,351 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 14:07:56,358 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0006_000001 (auth:SIMPLE) 2023-07-22 14:07:56,759 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0007_000001 (auth:SIMPLE) 2023-07-22 14:07:57,185 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:08:01,931 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0007_000001 (auth:SIMPLE) 2023-07-22 14:08:04,327 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0007_000001 (auth:SIMPLE) 2023-07-22 14:08:09,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0007_000001 (auth:SIMPLE) 2023-07-22 14:08:10,934 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 14:08:10,934 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 14:08:10,964 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,964 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 14:08:10,965 INFO [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 14:08:10,965 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,966 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 14:08:10,967 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 14:08:10,967 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-962047688_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,968 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 14:08:10,968 DEBUG [Listener at jenkins-hbase4.apache.org/35687] snapshot.TestExportSnapshot(367): hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/export-test/export-1690034874459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 14:08:10,984 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:10,991 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034890991"}]},"ts":"1690034890991"} 2023-07-22 14:08:10,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 14:08:10,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 14:08:10,994 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 14:08:10,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, UNASSIGN}] 2023-07-22 14:08:10,998 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, UNASSIGN 2023-07-22 14:08:10,998 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, UNASSIGN 2023-07-22 14:08:10,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6944870251b7fedec2db4c5769090420, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:08:10,999 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=18ce8e30c27f06bc89e8f43f0bda5c4c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:08:10,999 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034890999"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034890999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034890999"}]},"ts":"1690034890999"} 2023-07-22 14:08:10,999 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034890999"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690034890999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690034890999"}]},"ts":"1690034890999"} 2023-07-22 14:08:11,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6944870251b7fedec2db4c5769090420, server=jenkins-hbase4.apache.org,45699,1690034759741}] 2023-07-22 14:08:11,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 18ce8e30c27f06bc89e8f43f0bda5c4c, server=jenkins-hbase4.apache.org,39735,1690034759682}] 2023-07-22 14:08:11,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 14:08:11,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6944870251b7fedec2db4c5769090420 2023-07-22 14:08:11,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6944870251b7fedec2db4c5769090420, disabling compactions & flushes 2023-07-22 14:08:11,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:08:11,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:08:11,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. after waiting 0 ms 2023-07-22 14:08:11,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:08:11,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:08:11,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18ce8e30c27f06bc89e8f43f0bda5c4c, disabling compactions & flushes 2023-07-22 14:08:11,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:08:11,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:08:11,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. after waiting 0 ms 2023-07-22 14:08:11,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:08:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:08:11,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:11,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c. 2023-07-22 14:08:11,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18ce8e30c27f06bc89e8f43f0bda5c4c: 2023-07-22 14:08:11,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:08:11,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:08:11,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:11,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420. 2023-07-22 14:08:11,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6944870251b7fedec2db4c5769090420: 2023-07-22 14:08:11,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=18ce8e30c27f06bc89e8f43f0bda5c4c, regionState=CLOSED 2023-07-22 14:08:11,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034891179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034891179"}]},"ts":"1690034891179"} 2023-07-22 14:08:11,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6944870251b7fedec2db4c5769090420 2023-07-22 14:08:11,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6944870251b7fedec2db4c5769090420, regionState=CLOSED 2023-07-22 14:08:11,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690034891182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690034891182"}]},"ts":"1690034891182"} 2023-07-22 14:08:11,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-22 14:08:11,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 18ce8e30c27f06bc89e8f43f0bda5c4c, server=jenkins-hbase4.apache.org,39735,1690034759682 in 179 msec 2023-07-22 14:08:11,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=18ce8e30c27f06bc89e8f43f0bda5c4c, UNASSIGN in 190 msec 2023-07-22 14:08:11,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-22 14:08:11,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6944870251b7fedec2db4c5769090420, server=jenkins-hbase4.apache.org,45699,1690034759741 in 182 msec 2023-07-22 14:08:11,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-22 14:08:11,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6944870251b7fedec2db4c5769090420, UNASSIGN in 191 msec 2023-07-22 14:08:11,188 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690034891188"}]},"ts":"1690034891188"} 2023-07-22 14:08:11,189 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 14:08:11,191 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 14:08:11,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 207 msec 2023-07-22 14:08:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 14:08:11,297 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 14:08:11,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,302 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,303 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39735] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,308 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,308 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,308 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,308 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,308 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:08:11,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 14:08:11,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 14:08:11,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 14:08:11,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 14:08:11,309 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:08:11,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,309 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:08:11,310 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 14:08:11,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 14:08:11,311 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/recovered.edits] 2023-07-22 14:08:11,312 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf, FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/recovered.edits] 2023-07-22 14:08:11,317 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/cf/d2dd8934e8e84f08bf5f2ad58b312d6d 2023-07-22 14:08:11,318 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/cf/0a76cd0a71aa4272b9fcf9cc3ceaaf7f 2023-07-22 14:08:11,320 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c/recovered.edits/9.seqid 2023-07-22 14:08:11,321 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/18ce8e30c27f06bc89e8f43f0bda5c4c 2023-07-22 14:08:11,321 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/recovered.edits/9.seqid to hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420/recovered.edits/9.seqid 2023-07-22 14:08:11,322 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6944870251b7fedec2db4c5769090420 2023-07-22 14:08:11,322 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 14:08:11,325 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,326 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 14:08:11,329 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 14:08:11,330 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,330 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 14:08:11,330 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034891330"}]},"ts":"9223372036854775807"} 2023-07-22 14:08:11,330 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690034891330"}]},"ts":"9223372036854775807"} 2023-07-22 14:08:11,332 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 14:08:11,332 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6944870251b7fedec2db4c5769090420, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690034871935.6944870251b7fedec2db4c5769090420.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 18ce8e30c27f06bc89e8f43f0bda5c4c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690034871935.18ce8e30c27f06bc89e8f43f0bda5c4c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 14:08:11,332 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 14:08:11,332 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690034891332"}]},"ts":"9223372036854775807"} 2023-07-22 14:08:11,336 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 14:08:11,337 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-07-22 14:08:11,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 14:08:11,413 INFO [Listener at jenkins-hbase4.apache.org/35687] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 14:08:11,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 14:08:11,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 14:08:11,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36585] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 14:08:11,461 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769 (was 767) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:60118 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:57358 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-962047688_17 at /127.0.0.1:56920 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:43169 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5324 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1287033252_1 at /127.0.0.1:56042 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cd4a75-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=772 (was 760) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=5058 (was 5633) 2023-07-22 14:08:11,461 WARN [Listener at jenkins-hbase4.apache.org/35687] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-22 14:08:11,461 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 14:08:11,475 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 14:08:15,193 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690034767394_0007_000001 (auth:SIMPLE) 2023-07-22 14:08:16,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 14:08:25,607 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 14:08:39,740 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 14:08:39,741 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 14:08:39,853 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 14:08:39,863 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 14:08:39,864 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 14:08:39,876 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 14:08:39,980 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 14:08:39,980 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 14:08:39,980 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 14:08:39,980 INFO [Listener at jenkins-hbase4.apache.org/35687] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 14:08:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/35687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33146fc9 to 127.0.0.1:59777 2023-07-22 14:08:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:39,981 DEBUG [Listener at jenkins-hbase4.apache.org/35687] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 14:08:39,981 DEBUG [Listener at jenkins-hbase4.apache.org/35687] util.JVMClusterUtil(257): Found active master hash=1245815773, stopped=false 2023-07-22 14:08:39,981 DEBUG [Listener at jenkins-hbase4.apache.org/35687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:39,981 DEBUG [Listener at jenkins-hbase4.apache.org/35687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 14:08:39,981 INFO [Listener at jenkins-hbase4.apache.org/35687] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:08:39,983 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 14:08:39,983 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 14:08:39,983 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:08:39,983 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 14:08:39,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:08:39,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:08:39,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:08:39,984 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 14:08:39,984 INFO [Listener at jenkins-hbase4.apache.org/35687] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 14:08:39,984 DEBUG [Listener at jenkins-hbase4.apache.org/35687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2853067e to 127.0.0.1:59777 2023-07-22 14:08:39,984 DEBUG [Listener at jenkins-hbase4.apache.org/35687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:39,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45383,1690034759616' ***** 2023-07-22 14:08:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/35687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39735,1690034759682' ***** 2023-07-22 14:08:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/35687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45699,1690034759741' ***** 2023-07-22 14:08:39,985 DEBUG [Listener at jenkins-hbase4.apache.org/35687] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:39,985 INFO [RS:1;jenkins-hbase4:39735] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 14:08:39,985 INFO [RS:0;jenkins-hbase4:45383] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 14:08:39,985 INFO [Listener at jenkins-hbase4.apache.org/35687] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 14:08:39,986 INFO [RS:1;jenkins-hbase4:39735] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 14:08:39,986 INFO [RS:0;jenkins-hbase4:45383] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 14:08:39,986 INFO [RS:0;jenkins-hbase4:45383] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 14:08:39,986 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 14:08:39,986 INFO [RS:2;jenkins-hbase4:45699] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 14:08:39,986 INFO [RS:2;jenkins-hbase4:45699] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 14:08:39,986 INFO [RS:2;jenkins-hbase4:45699] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 14:08:39,986 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:08:39,986 DEBUG [RS:2;jenkins-hbase4:45699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ccadd34 to 127.0.0.1:59777 2023-07-22 14:08:39,986 DEBUG [RS:2;jenkins-hbase4:45699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:39,986 INFO [RS:1;jenkins-hbase4:39735] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 14:08:39,986 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 14:08:39,986 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(3305): Received CLOSE for 3141443fed49e1c869b14de48c060609 2023-07-22 14:08:39,987 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:08:39,987 DEBUG [RS:1;jenkins-hbase4:39735] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a7830d4 to 127.0.0.1:59777 2023-07-22 14:08:39,987 DEBUG [RS:1;jenkins-hbase4:39735] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:39,986 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(3305): Received CLOSE for 0926df7e0d7da1cb6ca8ae31f987e757 2023-07-22 14:08:39,986 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 14:08:39,992 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:08:39,993 DEBUG [RS:0;jenkins-hbase4:45383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c1c4d65 to 127.0.0.1:59777 2023-07-22 14:08:39,993 DEBUG [RS:0;jenkins-hbase4:45383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:39,991 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45699,1690034759741; all regions closed. 2023-07-22 14:08:39,991 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-22 14:08:39,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0926df7e0d7da1cb6ca8ae31f987e757, disabling compactions & flushes 2023-07-22 14:08:39,994 INFO [RS:0;jenkins-hbase4:45383] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 14:08:39,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3141443fed49e1c869b14de48c060609, disabling compactions & flushes 2023-07-22 14:08:39,995 INFO [RS:0;jenkins-hbase4:45383] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 14:08:39,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:08:39,995 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1478): Online Regions={3141443fed49e1c869b14de48c060609=hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609.} 2023-07-22 14:08:39,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:08:39,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. after waiting 0 ms 2023-07-22 14:08:39,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:08:39,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0926df7e0d7da1cb6ca8ae31f987e757 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 14:08:39,995 INFO [RS:0;jenkins-hbase4:45383] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 14:08:39,996 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 14:08:39,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:08:39,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:08:39,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. after waiting 0 ms 2023-07-22 14:08:39,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:08:39,996 DEBUG [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1504): Waiting on 3141443fed49e1c869b14de48c060609 2023-07-22 14:08:39,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3141443fed49e1c869b14de48c060609 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 14:08:39,998 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:39,998 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-22 14:08:39,999 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 0926df7e0d7da1cb6ca8ae31f987e757=hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757.} 2023-07-22 14:08:40,001 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 14:08:40,001 DEBUG [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1504): Waiting on 0926df7e0d7da1cb6ca8ae31f987e757, 1588230740 2023-07-22 14:08:40,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 14:08:40,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 14:08:40,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 14:08:40,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 14:08:40,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 14:08:40,005 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:40,016 DEBUG [RS:2;jenkins-hbase4:45699] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs 2023-07-22 14:08:40,016 INFO [RS:2;jenkins-hbase4:45699] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45699%2C1690034759741:(num 1690034761978) 2023-07-22 14:08:40,016 DEBUG [RS:2;jenkins-hbase4:45699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:40,016 INFO [RS:2;jenkins-hbase4:45699] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:40,016 INFO [RS:2;jenkins-hbase4:45699] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 14:08:40,017 INFO [RS:2;jenkins-hbase4:45699] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 14:08:40,017 INFO [RS:2;jenkins-hbase4:45699] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 14:08:40,017 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 14:08:40,017 INFO [RS:2;jenkins-hbase4:45699] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 14:08:40,021 INFO [RS:2;jenkins-hbase4:45699] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45699 2023-07-22 14:08:40,029 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,029 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:08:40,029 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:08:40,029 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,030 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45699,1690034759741 2023-07-22 14:08:40,030 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,030 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/.tmp/l/a32db60fefb1431a8133e38f6aea1630 2023-07-22 14:08:40,032 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45699,1690034759741] 2023-07-22 14:08:40,032 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45699,1690034759741; numProcessing=1 2023-07-22 14:08:40,034 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45699,1690034759741 already deleted, retry=false 2023-07-22 14:08:40,034 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45699,1690034759741 expired; onlineServers=2 2023-07-22 14:08:40,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/.tmp/info/056ab300577940899f839dc5467e3d82 2023-07-22 14:08:40,036 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:40,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/info/f24fc70e65e6487da035a1967ad5f20a 2023-07-22 14:08:40,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a32db60fefb1431a8133e38f6aea1630 2023-07-22 14:08:40,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/.tmp/l/a32db60fefb1431a8133e38f6aea1630 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/l/a32db60fefb1431a8133e38f6aea1630 2023-07-22 14:08:40,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/.tmp/info/056ab300577940899f839dc5467e3d82 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/info/056ab300577940899f839dc5467e3d82 2023-07-22 14:08:40,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24fc70e65e6487da035a1967ad5f20a 2023-07-22 14:08:40,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a32db60fefb1431a8133e38f6aea1630 2023-07-22 14:08:40,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/l/a32db60fefb1431a8133e38f6aea1630, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 14:08:40,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/info/056ab300577940899f839dc5467e3d82, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 14:08:40,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 3141443fed49e1c869b14de48c060609 in 55ms, sequenceid=18, compaction requested=false 2023-07-22 14:08:40,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0926df7e0d7da1cb6ca8ae31f987e757 in 57ms, sequenceid=6, compaction requested=false 2023-07-22 14:08:40,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/acl/3141443fed49e1c869b14de48c060609/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 14:08:40,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:40,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:08:40,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3141443fed49e1c869b14de48c060609: 2023-07-22 14:08:40,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690034763368.3141443fed49e1c869b14de48c060609. 2023-07-22 14:08:40,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/namespace/0926df7e0d7da1cb6ca8ae31f987e757/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 14:08:40,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:40,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:08:40,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0926df7e0d7da1cb6ca8ae31f987e757: 2023-07-22 14:08:40,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690034762599.0926df7e0d7da1cb6ca8ae31f987e757. 2023-07-22 14:08:40,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/rep_barrier/f9ae5860a6174220a5f17fff0293209a 2023-07-22 14:08:40,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9ae5860a6174220a5f17fff0293209a 2023-07-22 14:08:40,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/table/a5b55820fdad4547b92c6f6e05f21d9b 2023-07-22 14:08:40,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5b55820fdad4547b92c6f6e05f21d9b 2023-07-22 14:08:40,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/info/f24fc70e65e6487da035a1967ad5f20a as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/info/f24fc70e65e6487da035a1967ad5f20a 2023-07-22 14:08:40,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24fc70e65e6487da035a1967ad5f20a 2023-07-22 14:08:40,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/info/f24fc70e65e6487da035a1967ad5f20a, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 14:08:40,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/rep_barrier/f9ae5860a6174220a5f17fff0293209a as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/rep_barrier/f9ae5860a6174220a5f17fff0293209a 2023-07-22 14:08:40,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9ae5860a6174220a5f17fff0293209a 2023-07-22 14:08:40,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/rep_barrier/f9ae5860a6174220a5f17fff0293209a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 14:08:40,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/.tmp/table/a5b55820fdad4547b92c6f6e05f21d9b as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/table/a5b55820fdad4547b92c6f6e05f21d9b 2023-07-22 14:08:40,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5b55820fdad4547b92c6f6e05f21d9b 2023-07-22 14:08:40,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/table/a5b55820fdad4547b92c6f6e05f21d9b, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 14:08:40,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 108ms, sequenceid=131, compaction requested=false 2023-07-22 14:08:40,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 14:08:40,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 14:08:40,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 14:08:40,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 14:08:40,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 14:08:40,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 14:08:40,134 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,134 INFO [RS:2;jenkins-hbase4:45699] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45699,1690034759741; zookeeper connection closed. 2023-07-22 14:08:40,134 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45699-0x1018d5a618a0003, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,134 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@e876de5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@e876de5 2023-07-22 14:08:40,196 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39735,1690034759682; all regions closed. 2023-07-22 14:08:40,202 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45383,1690034759616; all regions closed. 2023-07-22 14:08:40,204 DEBUG [RS:1;jenkins-hbase4:39735] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs 2023-07-22 14:08:40,204 INFO [RS:1;jenkins-hbase4:39735] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39735%2C1690034759682:(num 1690034761972) 2023-07-22 14:08:40,204 DEBUG [RS:1;jenkins-hbase4:39735] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:40,204 INFO [RS:1;jenkins-hbase4:39735] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:40,205 INFO [RS:1;jenkins-hbase4:39735] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 14:08:40,207 INFO [RS:1;jenkins-hbase4:39735] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 14:08:40,207 INFO [RS:1;jenkins-hbase4:39735] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 14:08:40,207 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 14:08:40,207 INFO [RS:1;jenkins-hbase4:39735] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 14:08:40,208 INFO [RS:1;jenkins-hbase4:39735] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39735 2023-07-22 14:08:40,209 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:08:40,209 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,209 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39735,1690034759682 2023-07-22 14:08:40,210 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39735,1690034759682] 2023-07-22 14:08:40,210 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39735,1690034759682; numProcessing=2 2023-07-22 14:08:40,212 DEBUG [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs 2023-07-22 14:08:40,212 INFO [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45383%2C1690034759616.meta:.meta(num 1690034762159) 2023-07-22 14:08:40,212 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39735,1690034759682 already deleted, retry=false 2023-07-22 14:08:40,212 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39735,1690034759682 expired; onlineServers=1 2023-07-22 14:08:40,224 DEBUG [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/oldWALs 2023-07-22 14:08:40,224 INFO [RS:0;jenkins-hbase4:45383] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45383%2C1690034759616:(num 1690034761971) 2023-07-22 14:08:40,224 DEBUG [RS:0;jenkins-hbase4:45383] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:40,224 INFO [RS:0;jenkins-hbase4:45383] regionserver.LeaseManager(133): Closed leases 2023-07-22 14:08:40,224 INFO [RS:0;jenkins-hbase4:45383] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 14:08:40,224 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 14:08:40,225 INFO [RS:0;jenkins-hbase4:45383] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45383 2023-07-22 14:08:40,311 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,311 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:39735-0x1018d5a618a0002, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,311 INFO [RS:1;jenkins-hbase4:39735] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39735,1690034759682; zookeeper connection closed. 2023-07-22 14:08:40,312 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b33c22] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b33c22 2023-07-22 14:08:40,312 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45383,1690034759616 2023-07-22 14:08:40,312 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 14:08:40,313 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45383,1690034759616] 2023-07-22 14:08:40,314 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45383,1690034759616; numProcessing=3 2023-07-22 14:08:40,315 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45383,1690034759616 already deleted, retry=false 2023-07-22 14:08:40,315 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45383,1690034759616 expired; onlineServers=0 2023-07-22 14:08:40,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36585,1690034758169' ***** 2023-07-22 14:08:40,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 14:08:40,315 DEBUG [M:0;jenkins-hbase4:36585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 14:08:40,315 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36585,1690034758169 2023-07-22 14:08:40,315 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36585,1690034758169; all regions closed. 2023-07-22 14:08:40,315 DEBUG [M:0;jenkins-hbase4:36585] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 14:08:40,315 DEBUG [M:0;jenkins-hbase4:36585] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 14:08:40,315 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 14:08:40,316 DEBUG [M:0;jenkins-hbase4:36585] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 14:08:40,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690034761390] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690034761390,5,FailOnTimeoutGroup] 2023-07-22 14:08:40,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690034761391] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690034761391,5,FailOnTimeoutGroup] 2023-07-22 14:08:40,316 INFO [M:0;jenkins-hbase4:36585] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 14:08:40,316 INFO [M:0;jenkins-hbase4:36585] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 14:08:40,316 INFO [M:0;jenkins-hbase4:36585] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 14:08:40,316 DEBUG [M:0;jenkins-hbase4:36585] master.HMaster(1512): Stopping service threads 2023-07-22 14:08:40,316 INFO [M:0;jenkins-hbase4:36585] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 14:08:40,316 ERROR [M:0;jenkins-hbase4:36585] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 14:08:40,317 INFO [M:0;jenkins-hbase4:36585] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 14:08:40,317 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 14:08:40,318 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 14:08:40,318 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 14:08:40,318 DEBUG [M:0;jenkins-hbase4:36585] zookeeper.ZKUtil(398): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 14:08:40,318 WARN [M:0;jenkins-hbase4:36585] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 14:08:40,318 INFO [M:0;jenkins-hbase4:36585] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 14:08:40,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 14:08:40,318 INFO [M:0;jenkins-hbase4:36585] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 14:08:40,319 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 14:08:40,319 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:08:40,319 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:08:40,319 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 14:08:40,319 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:08:40,319 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.13 KB heapSize=449.38 KB 2023-07-22 14:08:40,333 INFO [M:0;jenkins-hbase4:36585] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.13 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6228c377ba5b43e1b3511ee62f925f60 2023-07-22 14:08:40,337 INFO [M:0;jenkins-hbase4:36585] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6228c377ba5b43e1b3511ee62f925f60 2023-07-22 14:08:40,338 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6228c377ba5b43e1b3511ee62f925f60 as hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6228c377ba5b43e1b3511ee62f925f60 2023-07-22 14:08:40,341 INFO [M:0;jenkins-hbase4:36585] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6228c377ba5b43e1b3511ee62f925f60 2023-07-22 14:08:40,341 INFO [M:0;jenkins-hbase4:36585] regionserver.HStore(1080): Added hdfs://localhost:42431/user/jenkins/test-data/b3af92c1-bffa-c8da-bafe-93ec0d32f9d1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6228c377ba5b43e1b3511ee62f925f60, entries=119, sequenceid=899, filesize=28.4 K 2023-07-22 14:08:40,342 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(2948): Finished flush of dataSize ~373.13 KB/382085, heapSize ~449.36 KB/460144, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-07-22 14:08:40,344 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 14:08:40,344 DEBUG [M:0;jenkins-hbase4:36585] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 14:08:40,346 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 14:08:40,346 INFO [M:0;jenkins-hbase4:36585] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 14:08:40,347 INFO [M:0;jenkins-hbase4:36585] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36585 2023-07-22 14:08:40,349 DEBUG [M:0;jenkins-hbase4:36585] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36585,1690034758169 already deleted, retry=false 2023-07-22 14:08:40,414 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,414 INFO [RS:0;jenkins-hbase4:45383] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45383,1690034759616; zookeeper connection closed. 2023-07-22 14:08:40,414 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): regionserver:45383-0x1018d5a618a0001, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,414 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1a5afd33] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1a5afd33 2023-07-22 14:08:40,414 INFO [Listener at jenkins-hbase4.apache.org/35687] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 14:08:40,514 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,514 INFO [M:0;jenkins-hbase4:36585] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36585,1690034758169; zookeeper connection closed. 2023-07-22 14:08:40,514 DEBUG [Listener at localhost/44727-EventThread] zookeeper.ZKWatcher(600): master:36585-0x1018d5a618a0000, quorum=127.0.0.1:59777, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 14:08:40,516 WARN [Listener at jenkins-hbase4.apache.org/35687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 14:08:40,524 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 14:08:40,627 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 14:08:40,627 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1205252694-172.31.14.131-1690034754243 (Datanode Uuid 8255682f-0042-40f2-8e91-12d01a9bb9d0) service to localhost/127.0.0.1:42431 2023-07-22 14:08:40,629 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data5/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,629 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data6/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,631 WARN [Listener at jenkins-hbase4.apache.org/35687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 14:08:40,639 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 14:08:40,742 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 14:08:40,742 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1205252694-172.31.14.131-1690034754243 (Datanode Uuid fda4813d-bb8d-4de5-b167-6293f6c9e9d3) service to localhost/127.0.0.1:42431 2023-07-22 14:08:40,743 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data3/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,743 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data4/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,744 WARN [Listener at jenkins-hbase4.apache.org/35687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 14:08:40,746 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 14:08:40,849 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 14:08:40,849 WARN [BP-1205252694-172.31.14.131-1690034754243 heartbeating to localhost/127.0.0.1:42431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1205252694-172.31.14.131-1690034754243 (Datanode Uuid 771f0c60-053e-4de8-b89e-1ee650bfc48c) service to localhost/127.0.0.1:42431 2023-07-22 14:08:40,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data1/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/148ce74e-c54b-c891-432d-7be15c60bfc4/cluster_6f33c771-2c06-aa27-59ad-a469a9e21c07/dfs/data/data2/current/BP-1205252694-172.31.14.131-1690034754243] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 14:08:40,884 INFO [Listener at jenkins-hbase4.apache.org/35687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 14:08:41,030 INFO [Listener at jenkins-hbase4.apache.org/35687] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 14:08:41,137 INFO [Listener at jenkins-hbase4.apache.org/35687] hbase.HBaseTestingUtility(1293): Minicluster is down