2023-09-25 22:01:34,701 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-25 22:01:34,884 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551 2023-09-25 22:01:34,884 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-25 22:01:34,885 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-25 22:01:34,924 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-25 22:01:35,167 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-25 22:01:35,168 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150, deleteOnExit=true 2023-09-25 22:01:35,168 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-25 22:01:35,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/test.cache.data in system properties and HBase conf 2023-09-25 22:01:35,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop.tmp.dir in system properties and HBase conf 2023-09-25 22:01:35,170 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop.log.dir in system properties and HBase conf 2023-09-25 22:01:35,170 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-25 22:01:35,171 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-25 22:01:35,171 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-25 22:01:35,463 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-25 22:01:35,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-25 22:01:35,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-25 22:01:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-25 22:01:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-25 22:01:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-25 22:01:35,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-25 22:01:35,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-25 22:01:35,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-25 22:01:35,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-25 22:01:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/nfs.dump.dir in system properties and HBase conf 2023-09-25 22:01:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir in system properties and HBase conf 2023-09-25 22:01:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-25 22:01:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-25 22:01:35,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-25 22:01:35,907 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-25 22:01:35,911 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-25 22:01:36,363 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-25 22:01:36,577 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-25 22:01:36,591 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:36,627 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:36,659 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_localhost_33629_hdfs____s5pxl3/webapp 2023-09-25 22:01:36,767 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33629 2023-09-25 22:01:36,815 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-25 22:01:36,815 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-25 22:01:37,355 WARN [Listener at localhost/44421] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-25 22:01:37,421 WARN [Listener at localhost/44421] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-25 22:01:37,438 WARN [Listener at localhost/44421] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:37,444 INFO [Listener at localhost/44421] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:37,449 INFO [Listener at localhost/44421] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_localhost_34607_datanode____1kwl9f/webapp 2023-09-25 22:01:37,539 INFO [Listener at localhost/44421] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34607 2023-09-25 22:01:37,941 WARN [Listener at localhost/35909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-25 22:01:37,958 WARN [Listener at localhost/35909] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-25 22:01:37,963 WARN [Listener at localhost/35909] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:37,965 INFO [Listener at localhost/35909] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:37,974 INFO [Listener at localhost/35909] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_localhost_35119_datanode____.7izbj6/webapp 2023-09-25 22:01:38,053 INFO [Listener at localhost/35909] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35119 2023-09-25 22:01:38,063 WARN [Listener at localhost/37323] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-25 22:01:38,077 WARN [Listener at localhost/37323] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-25 22:01:38,081 WARN [Listener at localhost/37323] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:38,084 INFO [Listener at localhost/37323] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:38,095 INFO [Listener at localhost/37323] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_localhost_43833_datanode____5kc9i8/webapp 2023-09-25 22:01:38,178 INFO [Listener at localhost/37323] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43833 2023-09-25 22:01:38,189 WARN [Listener at localhost/42335] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-25 22:01:39,421 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d6959f3d4d3c4af: Processing first storage report for DS-cf5d9698-bbd1-4167-bec8-88263df92001 from datanode 83cb8df3-cf83-4120-954f-b742be24602f 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d6959f3d4d3c4af: from storage DS-cf5d9698-bbd1-4167-bec8-88263df92001 node DatanodeRegistration(127.0.0.1:45725, datanodeUuid=83cb8df3-cf83-4120-954f-b742be24602f, infoPort=35261, infoSecurePort=0, ipcPort=35909, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c11406aabd830e2: Processing first storage report for DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df from datanode 50fd8cc2-dbd5-45b8-8ad0-98858d7734e8 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c11406aabd830e2: from storage DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df node DatanodeRegistration(127.0.0.1:42495, datanodeUuid=50fd8cc2-dbd5-45b8-8ad0-98858d7734e8, infoPort=37377, infoSecurePort=0, ipcPort=37323, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c873a6db7ea7d9: Processing first storage report for DS-7df52768-f321-4a0d-8959-091930541f80 from datanode 6a4c0343-cd09-42e1-9850-59acf4eefd7e 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c873a6db7ea7d9: from storage DS-7df52768-f321-4a0d-8959-091930541f80 node DatanodeRegistration(127.0.0.1:37521, datanodeUuid=6a4c0343-cd09-42e1-9850-59acf4eefd7e, infoPort=37193, infoSecurePort=0, ipcPort=42335, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d6959f3d4d3c4af: Processing first storage report for DS-a71394d4-8974-4757-b4a0-bba3d1b83d94 from datanode 83cb8df3-cf83-4120-954f-b742be24602f 2023-09-25 22:01:39,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d6959f3d4d3c4af: from storage DS-a71394d4-8974-4757-b4a0-bba3d1b83d94 node DatanodeRegistration(127.0.0.1:45725, datanodeUuid=83cb8df3-cf83-4120-954f-b742be24602f, infoPort=35261, infoSecurePort=0, ipcPort=35909, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,424 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c11406aabd830e2: Processing first storage report for DS-2e978f66-9474-40e2-a255-5c3db92a7ad3 from datanode 50fd8cc2-dbd5-45b8-8ad0-98858d7734e8 2023-09-25 22:01:39,424 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c11406aabd830e2: from storage DS-2e978f66-9474-40e2-a255-5c3db92a7ad3 node DatanodeRegistration(127.0.0.1:42495, datanodeUuid=50fd8cc2-dbd5-45b8-8ad0-98858d7734e8, infoPort=37377, infoSecurePort=0, ipcPort=37323, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,424 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c873a6db7ea7d9: Processing first storage report for DS-64e2933e-4e45-4141-afa6-027d7058ab7b from datanode 6a4c0343-cd09-42e1-9850-59acf4eefd7e 2023-09-25 22:01:39,424 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c873a6db7ea7d9: from storage DS-64e2933e-4e45-4141-afa6-027d7058ab7b node DatanodeRegistration(127.0.0.1:37521, datanodeUuid=6a4c0343-cd09-42e1-9850-59acf4eefd7e, infoPort=37193, infoSecurePort=0, ipcPort=42335, storageInfo=lv=-57;cid=testClusterID;nsid=1689799913;c=1695679295982), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-25 22:01:39,486 DEBUG [Listener at localhost/42335] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551 2023-09-25 22:01:39,578 INFO [Listener at localhost/42335] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/zookeeper_0, clientPort=60419, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-25 22:01:39,595 INFO [Listener at localhost/42335] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60419 2023-09-25 22:01:39,603 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:39,605 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:40,255 INFO [Listener at localhost/42335] util.FSUtils(471): Created version file at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 with version=8 2023-09-25 22:01:40,255 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/hbase-staging 2023-09-25 22:01:40,542 INFO [Listener at localhost/42335] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-25 22:01:40,941 INFO [Listener at localhost/42335] client.ConnectionUtils(127): master/jenkins-hbase16:0 server-side Connection retries=45 2023-09-25 22:01:40,969 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:40,970 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:40,970 INFO [Listener at localhost/42335] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-25 22:01:40,970 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:40,970 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-25 22:01:41,093 INFO [Listener at localhost/42335] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-25 22:01:41,155 DEBUG [Listener at localhost/42335] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-25 22:01:41,236 INFO [Listener at localhost/42335] ipc.NettyRpcServer(120): Bind to /188.40.62.62:36183 2023-09-25 22:01:41,247 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,249 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,275 INFO [Listener at localhost/42335] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36183 connecting to ZooKeeper ensemble=127.0.0.1:60419 2023-09-25 22:01:41,425 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:361830x0, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-25 22:01:41,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36183-0x100e51bb2a50000 connected 2023-09-25 22:01:41,504 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-25 22:01:41,505 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:01:41,515 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-25 22:01:41,522 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36183 2023-09-25 22:01:41,522 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36183 2023-09-25 22:01:41,522 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36183 2023-09-25 22:01:41,523 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36183 2023-09-25 22:01:41,523 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36183 2023-09-25 22:01:41,529 INFO [Listener at localhost/42335] master.HMaster(444): hbase.rootdir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, hbase.cluster.distributed=false 2023-09-25 22:01:41,586 INFO [Listener at localhost/42335] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-09-25 22:01:41,587 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,587 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,587 INFO [Listener at localhost/42335] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-25 22:01:41,587 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,587 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-25 22:01:41,591 INFO [Listener at localhost/42335] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-25 22:01:41,595 INFO [Listener at localhost/42335] ipc.NettyRpcServer(120): Bind to /188.40.62.62:40943 2023-09-25 22:01:41,598 INFO [Listener at localhost/42335] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-25 22:01:41,605 INFO [Listener at localhost/42335] mob.MobFileCache(124): MobFileCache disabled 2023-09-25 22:01:41,606 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,609 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,613 INFO [Listener at localhost/42335] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40943 connecting to ZooKeeper ensemble=127.0.0.1:60419 2023-09-25 22:01:41,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:409430x0, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-25 22:01:41,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40943-0x100e51bb2a50001 connected 2023-09-25 22:01:41,621 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-25 22:01:41,623 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:01:41,623 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-25 22:01:41,625 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40943 2023-09-25 22:01:41,625 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40943 2023-09-25 22:01:41,626 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40943 2023-09-25 22:01:41,626 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40943 2023-09-25 22:01:41,626 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40943 2023-09-25 22:01:41,636 INFO [Listener at localhost/42335] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-09-25 22:01:41,636 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,637 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,637 INFO [Listener at localhost/42335] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-25 22:01:41,637 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,637 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-25 22:01:41,638 INFO [Listener at localhost/42335] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-25 22:01:41,639 INFO [Listener at localhost/42335] ipc.NettyRpcServer(120): Bind to /188.40.62.62:33807 2023-09-25 22:01:41,640 INFO [Listener at localhost/42335] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-25 22:01:41,642 INFO [Listener at localhost/42335] mob.MobFileCache(124): MobFileCache disabled 2023-09-25 22:01:41,642 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,645 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,649 INFO [Listener at localhost/42335] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33807 connecting to ZooKeeper ensemble=127.0.0.1:60419 2023-09-25 22:01:41,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:338070x0, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-25 22:01:41,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33807-0x100e51bb2a50002 connected 2023-09-25 22:01:41,662 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-25 22:01:41,663 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:01:41,664 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-25 22:01:41,665 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33807 2023-09-25 22:01:41,665 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33807 2023-09-25 22:01:41,667 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33807 2023-09-25 22:01:41,667 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33807 2023-09-25 22:01:41,667 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33807 2023-09-25 22:01:41,677 INFO [Listener at localhost/42335] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-25 22:01:41,678 INFO [Listener at localhost/42335] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-25 22:01:41,680 INFO [Listener at localhost/42335] ipc.NettyRpcServer(120): Bind to /188.40.62.62:37003 2023-09-25 22:01:41,680 INFO [Listener at localhost/42335] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-25 22:01:41,681 INFO [Listener at localhost/42335] mob.MobFileCache(124): MobFileCache disabled 2023-09-25 22:01:41,682 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,683 INFO [Listener at localhost/42335] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,685 INFO [Listener at localhost/42335] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37003 connecting to ZooKeeper ensemble=127.0.0.1:60419 2023-09-25 22:01:41,694 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:370030x0, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-25 22:01:41,696 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:370030x0, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-25 22:01:41,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37003-0x100e51bb2a50003 connected 2023-09-25 22:01:41,697 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:01:41,698 DEBUG [Listener at localhost/42335] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-25 22:01:41,698 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37003 2023-09-25 22:01:41,698 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37003 2023-09-25 22:01:41,699 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37003 2023-09-25 22:01:41,699 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37003 2023-09-25 22:01:41,699 DEBUG [Listener at localhost/42335] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37003 2023-09-25 22:01:41,707 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:41,720 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-25 22:01:41,722 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:41,753 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-25 22:01:41,753 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-25 22:01:41,753 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-25 22:01:41,753 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-25 22:01:41,753 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:41,754 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-25 22:01:41,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-25 22:01:41,756 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase16.apache.org,36183,1695679300385 from backup master directory 2023-09-25 22:01:41,769 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:41,769 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-25 22:01:41,771 WARN [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-25 22:01:41,771 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:41,775 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-25 22:01:41,777 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-25 22:01:41,870 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/hbase.id with ID: 955bc5d3-6ed0-49b4-bc2b-0b3f4f562028 2023-09-25 22:01:41,904 INFO [master/jenkins-hbase16:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-25 22:01:41,928 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:41,997 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x55cf400e to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:42,039 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56cc24cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:42,063 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-25 22:01:42,065 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-25 22:01:42,081 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-25 22:01:42,081 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-25 22:01:42,084 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-25 22:01:42,089 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-25 22:01:42,090 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-25 22:01:42,122 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store-tmp 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-25 22:01:42,157 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:01:42,157 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:01:42,157 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-25 22:01:42,159 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/WALs/jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:42,181 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C36183%2C1695679300385, suffix=, logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/WALs/jenkins-hbase16.apache.org,36183,1695679300385, archiveDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/oldWALs, maxLogs=10 2023-09-25 22:01:42,237 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK] 2023-09-25 22:01:42,237 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK] 2023-09-25 22:01:42,237 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK] 2023-09-25 22:01:42,245 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-25 22:01:42,309 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/WALs/jenkins-hbase16.apache.org,36183,1695679300385/jenkins-hbase16.apache.org%2C36183%2C1695679300385.1695679302191 2023-09-25 22:01:42,309 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK], DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK], DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK]] 2023-09-25 22:01:42,310 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-25 22:01:42,310 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:42,314 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,316 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,384 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,394 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-25 22:01:42,424 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-25 22:01:42,435 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:42,442 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,444 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,463 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-25 22:01:42,468 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:42,469 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73983223, jitterRate=0.10243593156337738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:01:42,469 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-25 22:01:42,470 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-25 22:01:42,492 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-25 22:01:42,492 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-25 22:01:42,494 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-25 22:01:42,496 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-25 22:01:42,527 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 30 msec 2023-09-25 22:01:42,527 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-25 22:01:42,553 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-25 22:01:42,559 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-25 22:01:42,581 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-25 22:01:42,586 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-25 22:01:42,587 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-25 22:01:42,590 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-25 22:01:42,593 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-25 22:01:42,597 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-25 22:01:42,635 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:42,637 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-25 22:01:42,637 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-25 22:01:42,650 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-25 22:01:42,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-25 22:01:42,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-25 22:01:42,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-25 22:01:42,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-25 22:01:42,661 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:42,662 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase16.apache.org,36183,1695679300385, sessionid=0x100e51bb2a50000, setting cluster-up flag (Was=false) 2023-09-25 22:01:42,694 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:42,719 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-25 22:01:42,721 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:42,744 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:42,769 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-25 22:01:42,771 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:42,773 WARN [master/jenkins-hbase16:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp 2023-09-25 22:01:42,806 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(951): ClusterId : 955bc5d3-6ed0-49b4-bc2b-0b3f4f562028 2023-09-25 22:01:42,807 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(951): ClusterId : 955bc5d3-6ed0-49b4-bc2b-0b3f4f562028 2023-09-25 22:01:42,806 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(951): ClusterId : 955bc5d3-6ed0-49b4-bc2b-0b3f4f562028 2023-09-25 22:01:42,812 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-25 22:01:42,812 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-25 22:01:42,812 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-25 22:01:42,829 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-25 22:01:42,829 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-25 22:01:42,829 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-25 22:01:42,830 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-25 22:01:42,830 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-25 22:01:42,830 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-25 22:01:42,845 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-25 22:01:42,845 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-25 22:01:42,845 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-25 22:01:42,848 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ReadOnlyZKClient(139): Connect 0x6207ec09 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:42,849 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ReadOnlyZKClient(139): Connect 0x2a89c945 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:42,849 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ReadOnlyZKClient(139): Connect 0x6d077fbf to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:42,852 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-25 22:01:42,858 INFO [master/jenkins-hbase16:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:42,859 INFO [master/jenkins-hbase16:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-25 22:01:42,862 DEBUG [RS:2;jenkins-hbase16:37003] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cc00e39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:42,862 DEBUG [RS:1;jenkins-hbase16:33807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@244e3264, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:42,863 DEBUG [RS:1;jenkins-hbase16:33807] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2071a235, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-09-25 22:01:42,863 DEBUG [RS:2;jenkins-hbase16:37003] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ff8779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-09-25 22:01:42,863 DEBUG [RS:0;jenkins-hbase16:40943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63c09c6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:42,864 DEBUG [RS:0;jenkins-hbase16:40943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22fd9654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-09-25 22:01:42,886 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase16:37003 2023-09-25 22:01:42,886 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase16:33807 2023-09-25 22:01:42,886 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase16:40943 2023-09-25 22:01:42,893 INFO [RS:0;jenkins-hbase16:40943] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-25 22:01:42,893 INFO [RS:2;jenkins-hbase16:37003] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-25 22:01:42,894 INFO [RS:2;jenkins-hbase16:37003] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-25 22:01:42,893 INFO [RS:1;jenkins-hbase16:33807] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-25 22:01:42,893 INFO [RS:0;jenkins-hbase16:40943] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-25 22:01:42,894 INFO [RS:1;jenkins-hbase16:33807] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-25 22:01:42,894 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-25 22:01:42,894 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-25 22:01:42,894 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-25 22:01:42,895 INFO [RS:1;jenkins-hbase16:33807] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:42,895 INFO [RS:0;jenkins-hbase16:40943] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:42,895 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1022): About to register with Master. 2023-09-25 22:01:42,895 INFO [RS:2;jenkins-hbase16:37003] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:42,895 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1022): About to register with Master. 2023-09-25 22:01:42,895 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1022): About to register with Master. 2023-09-25 22:01:42,898 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,36183,1695679300385 with isa=jenkins-hbase16.apache.org/188.40.62.62:37003, startcode=1695679301677 2023-09-25 22:01:42,898 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,36183,1695679300385 with isa=jenkins-hbase16.apache.org/188.40.62.62:33807, startcode=1695679301636 2023-09-25 22:01:42,899 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,36183,1695679300385 with isa=jenkins-hbase16.apache.org/188.40.62.62:40943, startcode=1695679301586 2023-09-25 22:01:42,917 DEBUG [RS:0;jenkins-hbase16:40943] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-25 22:01:42,917 DEBUG [RS:1;jenkins-hbase16:33807] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-25 22:01:42,917 DEBUG [RS:2;jenkins-hbase16:37003] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-25 22:01:42,933 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase16:0, corePoolSize=10, maxPoolSize=10 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-09-25 22:01:42,973 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:42,976 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695679332976 2023-09-25 22:01:42,980 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-25 22:01:42,984 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-25 22:01:42,985 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-25 22:01:42,990 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-25 22:01:42,990 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-25 22:01:42,993 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54925, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-25 22:01:42,993 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:50513, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-25 22:01:42,993 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33731, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-25 22:01:42,998 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-25 22:01:43,000 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-25 22:01:43,000 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-25 22:01:43,000 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-25 22:01:43,001 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,002 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-25 22:01:43,004 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-25 22:01:43,004 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-25 22:01:43,005 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-25 22:01:43,006 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-25 22:01:43,007 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-25 22:01:43,011 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1695679303008,5,FailOnTimeoutGroup] 2023-09-25 22:01:43,011 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1695679303011,5,FailOnTimeoutGroup] 2023-09-25 22:01:43,011 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,011 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-25 22:01:43,012 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,013 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,020 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,026 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,033 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:43,033 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:43,033 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44421 2023-09-25 22:01:43,033 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44421 2023-09-25 22:01:43,033 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-25 22:01:43,034 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-25 22:01:43,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-25 22:01:43,050 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-25 22:01:43,050 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:43,052 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(2830): Master is not running yet 2023-09-25 22:01:43,052 WARN [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-25 22:01:43,052 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:01:43,072 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:43,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-25 22:01:43,076 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/info 2023-09-25 22:01:43,077 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-25 22:01:43,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-25 22:01:43,080 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/rep_barrier 2023-09-25 22:01:43,081 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-25 22:01:43,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-25 22:01:43,084 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/table 2023-09-25 22:01:43,084 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-25 22:01:43,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,087 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740 2023-09-25 22:01:43,088 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740 2023-09-25 22:01:43,091 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-25 22:01:43,094 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-25 22:01:43,098 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:43,099 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59374280, jitterRate=-0.11525428295135498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-25 22:01:43,100 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-25 22:01:43,100 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-25 22:01:43,100 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-25 22:01:43,100 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-25 22:01:43,100 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-25 22:01:43,100 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-25 22:01:43,102 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-25 22:01:43,103 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-25 22:01:43,109 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-25 22:01:43,109 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-25 22:01:43,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-25 22:01:43,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-25 22:01:43,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-25 22:01:43,153 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ZKUtil(162): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,153 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,36183,1695679300385 with isa=jenkins-hbase16.apache.org/188.40.62.62:37003, startcode=1695679301677 2023-09-25 22:01:43,153 WARN [RS:1;jenkins-hbase16:33807] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-25 22:01:43,153 INFO [RS:1;jenkins-hbase16:33807] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-25 22:01:43,153 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,154 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,33807,1695679301636] 2023-09-25 22:01:43,154 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,40943,1695679301586] 2023-09-25 22:01:43,154 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,154 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ZKUtil(162): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,155 WARN [RS:0;jenkins-hbase16:40943] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-25 22:01:43,156 INFO [RS:0;jenkins-hbase16:40943] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-25 22:01:43,156 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,157 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:43,157 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44421 2023-09-25 22:01:43,158 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-25 22:01:43,169 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:01:43,169 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ZKUtil(162): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,169 WARN [RS:2;jenkins-hbase16:37003] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-25 22:01:43,170 INFO [RS:2;jenkins-hbase16:37003] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-25 22:01:43,170 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,37003,1695679301677] 2023-09-25 22:01:43,170 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,172 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ZKUtil(162): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,172 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ZKUtil(162): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,173 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ZKUtil(162): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,173 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ZKUtil(162): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,174 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ZKUtil(162): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,174 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ZKUtil(162): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,175 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ZKUtil(162): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,175 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ZKUtil(162): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,176 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ZKUtil(162): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,184 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-25 22:01:43,184 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-25 22:01:43,184 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-25 22:01:43,195 INFO [RS:2;jenkins-hbase16:37003] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-25 22:01:43,195 INFO [RS:0;jenkins-hbase16:40943] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-25 22:01:43,195 INFO [RS:1;jenkins-hbase16:33807] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-25 22:01:43,218 INFO [RS:0;jenkins-hbase16:40943] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-25 22:01:43,218 INFO [RS:1;jenkins-hbase16:33807] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-25 22:01:43,218 INFO [RS:2;jenkins-hbase16:37003] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-25 22:01:43,223 INFO [RS:0;jenkins-hbase16:40943] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-25 22:01:43,223 INFO [RS:1;jenkins-hbase16:33807] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-25 22:01:43,223 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,224 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,224 INFO [RS:2;jenkins-hbase16:37003] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-25 22:01:43,224 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,224 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-25 22:01:43,224 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-25 22:01:43,225 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-25 22:01:43,233 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,233 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,233 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,233 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,234 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-09-25 22:01:43,235 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-09-25 22:01:43,235 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-09-25 22:01:43,235 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:0;jenkins-hbase16:40943] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:2;jenkins-hbase16:37003] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,235 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,236 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,236 DEBUG [RS:1;jenkins-hbase16:33807] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-09-25 22:01:43,243 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,243 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,244 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,259 INFO [RS:1;jenkins-hbase16:33807] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-25 22:01:43,259 INFO [RS:2;jenkins-hbase16:37003] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-25 22:01:43,259 INFO [RS:0;jenkins-hbase16:40943] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-25 22:01:43,263 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37003,1695679301677-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,263 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,40943,1695679301586-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,263 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,33807,1695679301636-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,290 INFO [RS:0;jenkins-hbase16:40943] regionserver.Replication(203): jenkins-hbase16.apache.org,40943,1695679301586 started 2023-09-25 22:01:43,290 INFO [RS:1;jenkins-hbase16:33807] regionserver.Replication(203): jenkins-hbase16.apache.org,33807,1695679301636 started 2023-09-25 22:01:43,290 INFO [RS:2;jenkins-hbase16:37003] regionserver.Replication(203): jenkins-hbase16.apache.org,37003,1695679301677 started 2023-09-25 22:01:43,290 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,33807,1695679301636, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:33807, sessionid=0x100e51bb2a50002 2023-09-25 22:01:43,290 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,40943,1695679301586, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:40943, sessionid=0x100e51bb2a50001 2023-09-25 22:01:43,290 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,37003,1695679301677, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:37003, sessionid=0x100e51bb2a50003 2023-09-25 22:01:43,291 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-25 22:01:43,291 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-25 22:01:43,291 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-25 22:01:43,291 DEBUG [RS:1;jenkins-hbase16:33807] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,291 DEBUG [RS:2;jenkins-hbase16:37003] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,292 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,33807,1695679301636' 2023-09-25 22:01:43,293 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-25 22:01:43,294 DEBUG [jenkins-hbase16:36183] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-25 22:01:43,292 DEBUG [RS:0;jenkins-hbase16:40943] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,299 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,40943,1695679301586' 2023-09-25 22:01:43,299 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-25 22:01:43,292 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,37003,1695679301677' 2023-09-25 22:01:43,299 DEBUG [jenkins-hbase16:36183] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:01:43,299 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-25 22:01:43,300 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-25 22:01:43,300 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-25 22:01:43,301 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-25 22:01:43,301 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-25 22:01:43,301 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-25 22:01:43,301 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-25 22:01:43,301 DEBUG [RS:0;jenkins-hbase16:40943] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,301 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,40943,1695679301586' 2023-09-25 22:01:43,302 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:43,301 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-25 22:01:43,302 DEBUG [RS:1;jenkins-hbase16:33807] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:43,302 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,33807,1695679301636' 2023-09-25 22:01:43,303 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:43,303 DEBUG [RS:0;jenkins-hbase16:40943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:43,303 DEBUG [RS:1;jenkins-hbase16:33807] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:43,302 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-25 22:01:43,303 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-25 22:01:43,304 DEBUG [RS:2;jenkins-hbase16:37003] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:43,303 DEBUG [RS:0;jenkins-hbase16:40943] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-25 22:01:43,304 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,37003,1695679301677' 2023-09-25 22:01:43,304 INFO [RS:0;jenkins-hbase16:40943] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-25 22:01:43,304 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:43,304 INFO [RS:0;jenkins-hbase16:40943] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-25 22:01:43,304 DEBUG [RS:1;jenkins-hbase16:33807] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-25 22:01:43,304 INFO [RS:1;jenkins-hbase16:33807] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-25 22:01:43,305 DEBUG [RS:2;jenkins-hbase16:37003] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:43,305 INFO [RS:1;jenkins-hbase16:33807] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-25 22:01:43,307 DEBUG [RS:2;jenkins-hbase16:37003] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-25 22:01:43,307 INFO [RS:2;jenkins-hbase16:37003] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-25 22:01:43,308 INFO [RS:2;jenkins-hbase16:37003] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-25 22:01:43,309 DEBUG [jenkins-hbase16:36183] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:01:43,309 DEBUG [jenkins-hbase16:36183] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:01:43,309 DEBUG [jenkins-hbase16:36183] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:01:43,310 DEBUG [jenkins-hbase16:36183] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:01:43,313 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,40943,1695679301586, state=OPENING 2023-09-25 22:01:43,327 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-25 22:01:43,336 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:43,337 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-25 22:01:43,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:01:43,414 INFO [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C40943%2C1695679301586, suffix=, logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,40943,1695679301586, archiveDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs, maxLogs=32 2023-09-25 22:01:43,414 INFO [RS:2;jenkins-hbase16:37003] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C37003%2C1695679301677, suffix=, logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,37003,1695679301677, archiveDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs, maxLogs=32 2023-09-25 22:01:43,414 INFO [RS:1;jenkins-hbase16:33807] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C33807%2C1695679301636, suffix=, logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,33807,1695679301636, archiveDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs, maxLogs=32 2023-09-25 22:01:43,437 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK] 2023-09-25 22:01:43,437 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK] 2023-09-25 22:01:43,438 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK] 2023-09-25 22:01:43,443 INFO [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,40943,1695679301586/jenkins-hbase16.apache.org%2C40943%2C1695679301586.1695679303417 2023-09-25 22:01:43,444 DEBUG [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK], DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK], DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK]] 2023-09-25 22:01:43,451 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK] 2023-09-25 22:01:43,456 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK] 2023-09-25 22:01:43,457 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK] 2023-09-25 22:01:43,457 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK] 2023-09-25 22:01:43,458 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK] 2023-09-25 22:01:43,459 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK] 2023-09-25 22:01:43,475 INFO [RS:1;jenkins-hbase16:33807] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,33807,1695679301636/jenkins-hbase16.apache.org%2C33807%2C1695679301636.1695679303417 2023-09-25 22:01:43,475 INFO [RS:2;jenkins-hbase16:37003] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,37003,1695679301677/jenkins-hbase16.apache.org%2C37003%2C1695679301677.1695679303417 2023-09-25 22:01:43,475 DEBUG [RS:1;jenkins-hbase16:33807] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK], DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK], DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK]] 2023-09-25 22:01:43,475 DEBUG [RS:2;jenkins-hbase16:37003] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK], DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK], DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK]] 2023-09-25 22:01:43,527 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:43,529 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:01:43,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:01:43,544 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-25 22:01:43,545 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-25 22:01:43,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C40943%2C1695679301586.meta, suffix=.meta, logDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,40943,1695679301586, archiveDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs, maxLogs=32 2023-09-25 22:01:43,567 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK] 2023-09-25 22:01:43,569 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK] 2023-09-25 22:01:43,571 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK] 2023-09-25 22:01:43,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/WALs/jenkins-hbase16.apache.org,40943,1695679301586/jenkins-hbase16.apache.org%2C40943%2C1695679301586.meta.1695679303551.meta 2023-09-25 22:01:43,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37521,DS-7df52768-f321-4a0d-8959-091930541f80,DISK], DatanodeInfoWithStorage[127.0.0.1:42495,DS-25f9ac7f-8ec4-402f-b051-1f94ac7b03df,DISK], DatanodeInfoWithStorage[127.0.0.1:45725,DS-cf5d9698-bbd1-4167-bec8-88263df92001,DISK]] 2023-09-25 22:01:43,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-25 22:01:43,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-25 22:01:43,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:43,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-25 22:01:43,584 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-25 22:01:43,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-25 22:01:43,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-25 22:01:43,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:43,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-25 22:01:43,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-25 22:01:43,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-25 22:01:43,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/info 2023-09-25 22:01:43,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/info 2023-09-25 22:01:43,607 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-25 22:01:43,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-25 22:01:43,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/rep_barrier 2023-09-25 22:01:43,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/rep_barrier 2023-09-25 22:01:43,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-25 22:01:43,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-25 22:01:43,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/table 2023-09-25 22:01:43,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/table 2023-09-25 22:01:43,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-25 22:01:43,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:43,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740 2023-09-25 22:01:43,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740 2023-09-25 22:01:43,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-25 22:01:43,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-25 22:01:43,627 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63729404, jitterRate=-0.0503578782081604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-25 22:01:43,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-25 22:01:43,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695679303519 2023-09-25 22:01:43,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-25 22:01:43,657 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-25 22:01:43,658 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,40943,1695679301586, state=OPEN 2023-09-25 22:01:43,669 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-25 22:01:43,669 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-25 22:01:43,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-25 22:01:43,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,40943,1695679301586 in 328 msec 2023-09-25 22:01:43,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-25 22:01:43,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 556 msec 2023-09-25 22:01:43,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 818 msec 2023-09-25 22:01:43,688 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695679303687, completionTime=-1 2023-09-25 22:01:43,688 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-25 22:01:43,688 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-25 22:01:43,760 DEBUG [hconnection-0x3fec2d75-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:43,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:43,786 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-25 22:01:43,787 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695679363787 2023-09-25 22:01:43,787 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695679423787 2023-09-25 22:01:43,787 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 98 msec 2023-09-25 22:01:43,823 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,36183,1695679300385-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,823 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,36183,1695679300385-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,823 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,36183,1695679300385-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,825 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase16:36183, period=300000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,825 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-25 22:01:43,834 DEBUG [master/jenkins-hbase16:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-25 22:01:43,840 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-25 22:01:43,842 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-25 22:01:43,852 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-25 22:01:43,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:01:43,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:01:43,888 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:43,891 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5 empty. 2023-09-25 22:01:43,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:43,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-25 22:01:43,946 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-25 22:01:43,948 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => bba5ce3d3a6a22106640c3b1bd990dd5, NAME => 'hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:01:43,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:43,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing bba5ce3d3a6a22106640c3b1bd990dd5, disabling compactions & flushes 2023-09-25 22:01:43,973 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:43,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:43,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. after waiting 0 ms 2023-09-25 22:01:43,973 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:43,973 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:43,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for bba5ce3d3a6a22106640c3b1bd990dd5: 2023-09-25 22:01:43,978 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:01:43,994 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695679303981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679303981"}]},"ts":"1695679303981"} 2023-09-25 22:01:44,024 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-25 22:01:44,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:01:44,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679304026"}]},"ts":"1695679304026"} 2023-09-25 22:01:44,040 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-25 22:01:44,062 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:01:44,063 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:01:44,063 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:01:44,063 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:01:44,063 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:01:44,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bba5ce3d3a6a22106640c3b1bd990dd5, ASSIGN}] 2023-09-25 22:01:44,091 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bba5ce3d3a6a22106640c3b1bd990dd5, ASSIGN 2023-09-25 22:01:44,094 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bba5ce3d3a6a22106640c3b1bd990dd5, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,37003,1695679301677; forceNewPlan=false, retain=false 2023-09-25 22:01:44,247 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-25 22:01:44,248 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bba5ce3d3a6a22106640c3b1bd990dd5, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:44,249 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695679304248"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679304248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679304248"}]},"ts":"1695679304248"} 2023-09-25 22:01:44,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bba5ce3d3a6a22106640c3b1bd990dd5, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:01:44,413 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:44,413 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:01:44,418 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:01:44,426 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:44,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bba5ce3d3a6a22106640c3b1bd990dd5, NAME => 'hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.', STARTKEY => '', ENDKEY => ''} 2023-09-25 22:01:44,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. service=AccessControlService 2023-09-25 22:01:44,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:44,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:44,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,433 INFO [StoreOpener-bba5ce3d3a6a22106640c3b1bd990dd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,437 DEBUG [StoreOpener-bba5ce3d3a6a22106640c3b1bd990dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/info 2023-09-25 22:01:44,437 DEBUG [StoreOpener-bba5ce3d3a6a22106640c3b1bd990dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/info 2023-09-25 22:01:44,438 INFO [StoreOpener-bba5ce3d3a6a22106640c3b1bd990dd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bba5ce3d3a6a22106640c3b1bd990dd5 columnFamilyName info 2023-09-25 22:01:44,439 INFO [StoreOpener-bba5ce3d3a6a22106640c3b1bd990dd5-1] regionserver.HStore(310): Store=bba5ce3d3a6a22106640c3b1bd990dd5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:44,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:01:44,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:44,464 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened bba5ce3d3a6a22106640c3b1bd990dd5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60867549, jitterRate=-0.09300284087657928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:01:44,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for bba5ce3d3a6a22106640c3b1bd990dd5: 2023-09-25 22:01:44,468 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5., pid=6, masterSystemTime=1695679304413 2023-09-25 22:01:44,474 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:44,475 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:01:44,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bba5ce3d3a6a22106640c3b1bd990dd5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:44,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695679304477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679304477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679304477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679304477"}]},"ts":"1695679304477"} 2023-09-25 22:01:44,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-25 22:01:44,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bba5ce3d3a6a22106640c3b1bd990dd5, server=jenkins-hbase16.apache.org,37003,1695679301677 in 226 msec 2023-09-25 22:01:44,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-25 22:01:44,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bba5ce3d3a6a22106640c3b1bd990dd5, ASSIGN in 421 msec 2023-09-25 22:01:44,503 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:01:44,503 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679304503"}]},"ts":"1695679304503"} 2023-09-25 22:01:44,507 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-25 22:01:44,546 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:01:44,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 704 msec 2023-09-25 22:01:44,556 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-25 22:01:44,561 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-25 22:01:44,561 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:44,586 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:44,588 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:44,604 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-25 22:01:44,636 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-25 22:01:44,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 54 msec 2023-09-25 22:01:44,658 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-25 22:01:44,677 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-25 22:01:44,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 31 msec 2023-09-25 22:01:44,719 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-25 22:01:44,736 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-25 22:01:44,736 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.965sec 2023-09-25 22:01:44,739 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-25 22:01:44,741 INFO [master/jenkins-hbase16:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-25 22:01:44,741 INFO [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-25 22:01:44,742 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,36183,1695679300385-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-25 22:01:44,743 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,36183,1695679300385-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-25 22:01:44,763 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-25 22:01:44,765 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-25 22:01:44,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:01:44,770 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:01:44,773 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:44,773 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-25 22:01:44,774 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4 empty. 2023-09-25 22:01:44,776 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:44,776 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-25 22:01:44,784 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-25 22:01:44,806 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-25 22:01:44,807 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d8abea0b5a4e2ea451d705050ff50e4, NAME => 'hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:01:44,817 DEBUG [Listener at localhost/42335] zookeeper.ReadOnlyZKClient(139): Connect 0x6194af79 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:44,829 DEBUG [Listener at localhost/42335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a774a27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:44,837 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:44,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0d8abea0b5a4e2ea451d705050ff50e4, disabling compactions & flushes 2023-09-25 22:01:44,838 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:44,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:44,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. after waiting 0 ms 2023-09-25 22:01:44,838 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:44,838 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:44,840 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0d8abea0b5a4e2ea451d705050ff50e4: 2023-09-25 22:01:44,845 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:01:44,848 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695679304848"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679304848"}]},"ts":"1695679304848"} 2023-09-25 22:01:44,849 DEBUG [hconnection-0x230246c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:44,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-25 22:01:44,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:01:44,854 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679304854"}]},"ts":"1695679304854"} 2023-09-25 22:01:44,856 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-25 22:01:44,861 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:44,864 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:01:44,864 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-25 22:01:44,864 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/test.cache.data in system properties and HBase conf 2023-09-25 22:01:44,864 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop.tmp.dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop.log.dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-25 22:01:44,865 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/nfs.dump.dir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-25 22:01:44,866 INFO [Listener at localhost/42335] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-25 22:01:44,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:01:44,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:01:44,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:01:44,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:01:44,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:01:44,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0d8abea0b5a4e2ea451d705050ff50e4, ASSIGN}] 2023-09-25 22:01:44,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0d8abea0b5a4e2ea451d705050ff50e4, ASSIGN 2023-09-25 22:01:44,887 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0d8abea0b5a4e2ea451d705050ff50e4, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:01:44,888 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-25 22:01:45,037 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-25 22:01:45,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0d8abea0b5a4e2ea451d705050ff50e4, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:45,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695679305038"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679305038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679305038"}]},"ts":"1695679305038"} 2023-09-25 22:01:45,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0d8abea0b5a4e2ea451d705050ff50e4, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:01:45,088 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-25 22:01:45,197 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:45,197 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:01:45,201 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:01:45,208 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:45,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d8abea0b5a4e2ea451d705050ff50e4, NAME => 'hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.', STARTKEY => '', ENDKEY => ''} 2023-09-25 22:01:45,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. service=AccessControlService 2023-09-25 22:01:45,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:45,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:45,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,212 INFO [StoreOpener-0d8abea0b5a4e2ea451d705050ff50e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,214 DEBUG [StoreOpener-0d8abea0b5a4e2ea451d705050ff50e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/l 2023-09-25 22:01:45,214 DEBUG [StoreOpener-0d8abea0b5a4e2ea451d705050ff50e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/l 2023-09-25 22:01:45,215 INFO [StoreOpener-0d8abea0b5a4e2ea451d705050ff50e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d8abea0b5a4e2ea451d705050ff50e4 columnFamilyName l 2023-09-25 22:01:45,216 INFO [StoreOpener-0d8abea0b5a4e2ea451d705050ff50e4-1] regionserver.HStore(310): Store=0d8abea0b5a4e2ea451d705050ff50e4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:45,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,221 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:01:45,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:45,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 0d8abea0b5a4e2ea451d705050ff50e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68451977, jitterRate=0.020013943314552307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:01:45,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 0d8abea0b5a4e2ea451d705050ff50e4: 2023-09-25 22:01:45,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4., pid=11, masterSystemTime=1695679305197 2023-09-25 22:01:45,238 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:45,239 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:01:45,240 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0d8abea0b5a4e2ea451d705050ff50e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:45,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695679305240"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679305240"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679305240"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679305240"}]},"ts":"1695679305240"} 2023-09-25 22:01:45,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-25 22:01:45,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0d8abea0b5a4e2ea451d705050ff50e4, server=jenkins-hbase16.apache.org,33807,1695679301636 in 201 msec 2023-09-25 22:01:45,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-25 22:01:45,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0d8abea0b5a4e2ea451d705050ff50e4, ASSIGN in 365 msec 2023-09-25 22:01:45,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:01:45,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679305252"}]},"ts":"1695679305252"} 2023-09-25 22:01:45,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-25 22:01:45,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:01:45,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 500 msec 2023-09-25 22:01:45,389 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-25 22:01:45,389 INFO [master/jenkins-hbase16:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-25 22:01:45,398 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-25 22:01:45,903 WARN [Thread-381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:46,199 INFO [Thread-381] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:46,206 INFO [Thread-381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_33023_jobhistory____hsou9z/webapp 2023-09-25 22:01:46,368 INFO [Thread-381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-25 22:01:46,368 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-25 22:01:46,368 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-25 22:01:46,372 INFO [Thread-381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-25 22:01:46,453 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:46,772 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:47,047 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-25 22:01:47,079 INFO [Thread-381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:33023 2023-09-25 22:01:47,398 WARN [Listener at jenkins-hbase16.apache.org/34605] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:47,626 WARN [Listener at jenkins-hbase16.apache.org/34605] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-25 22:01:47,627 INFO [Listener at jenkins-hbase16.apache.org/34605] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:47,636 INFO [Listener at jenkins-hbase16.apache.org/34605] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_34979_cluster____.decpib/webapp 2023-09-25 22:01:47,700 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-25 22:01:47,701 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-25 22:01:47,701 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-25 22:01:47,701 INFO [Listener at jenkins-hbase16.apache.org/34605] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-25 22:01:47,711 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:47,886 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:47,969 INFO [Listener at jenkins-hbase16.apache.org/34605] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:47,979 INFO [Listener at jenkins-hbase16.apache.org/34605] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:34979 2023-09-25 22:01:48,408 WARN [Listener at jenkins-hbase16.apache.org/32835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:48,430 WARN [Listener at jenkins-hbase16.apache.org/32835] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-25 22:01:48,430 INFO [Listener at jenkins-hbase16.apache.org/32835] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:48,436 INFO [Listener at jenkins-hbase16.apache.org/32835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_41393_node____.a31xz9/webapp 2023-09-25 22:01:48,478 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-25 22:01:48,478 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-25 22:01:48,478 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-25 22:01:48,479 INFO [Listener at jenkins-hbase16.apache.org/32835] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-25 22:01:48,487 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,504 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,563 INFO [Listener at jenkins-hbase16.apache.org/32835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,574 INFO [Listener at jenkins-hbase16.apache.org/32835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:41393 2023-09-25 22:01:48,783 WARN [Listener at jenkins-hbase16.apache.org/37563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-25 22:01:48,789 WARN [Listener at jenkins-hbase16.apache.org/37563] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-25 22:01:48,790 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): jetty-6.1.26 2023-09-25 22:01:48,799 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_44441_node____.se8ydg/webapp 2023-09-25 22:01:48,846 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-25 22:01:48,846 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-25 22:01:48,846 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-25 22:01:48,846 INFO [Listener at jenkins-hbase16.apache.org/37563] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-25 22:01:48,854 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,867 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,940 INFO [Listener at jenkins-hbase16.apache.org/37563] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-25 22:01:48,947 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:44441 2023-09-25 22:01:48,975 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-25 22:01:48,977 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:01:49,050 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=165, AvailableMemoryMB=5035 2023-09-25 22:01:49,051 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-25 22:01:49,069 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-25 22:01:49,077 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:36908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-25 22:01:49,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:01:49,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:01:49,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:01:49,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-25 22:01:49,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:49,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:01:49,101 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:49,101 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:49,105 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 empty. 2023-09-25 22:01:49,105 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d empty. 2023-09-25 22:01:49,107 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:49,108 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:49,108 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-25 22:01:49,152 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-25 22:01:49,153 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9dd8ae177de2993cda34900abbf9df19, NAME => 'testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:01:49,154 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9e510c6ed771e56f550be920c653b50d, NAME => 'testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:01:49,190 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:01:49,207 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:49,209 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 9e510c6ed771e56f550be920c653b50d, disabling compactions & flushes 2023-09-25 22:01:49,209 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:49,209 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:49,209 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. after waiting 0 ms 2023-09-25 22:01:49,209 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:49,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:49,209 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:49,209 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 9e510c6ed771e56f550be920c653b50d: 2023-09-25 22:01:49,376 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-25 22:01:49,377 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-25 22:01:49,378 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-25 22:01:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:49,602 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:49,603 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9dd8ae177de2993cda34900abbf9df19, disabling compactions & flushes 2023-09-25 22:01:49,603 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:49,603 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:49,603 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. after waiting 0 ms 2023-09-25 22:01:49,603 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:49,603 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:49,603 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9dd8ae177de2993cda34900abbf9df19: 2023-09-25 22:01:49,607 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:01:49,609 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679309609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679309609"}]},"ts":"1695679309609"} 2023-09-25 22:01:49,609 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679309609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679309609"}]},"ts":"1695679309609"} 2023-09-25 22:01:49,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:01:49,660 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:01:49,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679309660"}]},"ts":"1695679309660"} 2023-09-25 22:01:49,662 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-25 22:01:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:49,720 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:01:49,722 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:01:49,722 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:01:49,722 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:01:49,722 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:01:49,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, ASSIGN}] 2023-09-25 22:01:49,726 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, ASSIGN 2023-09-25 22:01:49,726 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, ASSIGN 2023-09-25 22:01:49,728 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:01:49,728 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:01:49,878 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:01:49,881 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9e510c6ed771e56f550be920c653b50d, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:49,881 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9dd8ae177de2993cda34900abbf9df19, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:49,881 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679309880"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679309880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679309880"}]},"ts":"1695679309880"} 2023-09-25 22:01:49,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679309880"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679309880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679309880"}]},"ts":"1695679309880"} 2023-09-25 22:01:49,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 9e510c6ed771e56f550be920c653b50d, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:01:49,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 9dd8ae177de2993cda34900abbf9df19, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:01:50,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:50,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:50,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e510c6ed771e56f550be920c653b50d, NAME => 'testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:01:50,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dd8ae177de2993cda34900abbf9df19, NAME => 'testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. service=AccessControlService 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. service=AccessControlService 2023-09-25 22:01:50,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:50,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,049 INFO [StoreOpener-9dd8ae177de2993cda34900abbf9df19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,049 INFO [StoreOpener-9e510c6ed771e56f550be920c653b50d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,052 DEBUG [StoreOpener-9dd8ae177de2993cda34900abbf9df19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf 2023-09-25 22:01:50,052 DEBUG [StoreOpener-9e510c6ed771e56f550be920c653b50d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf 2023-09-25 22:01:50,052 DEBUG [StoreOpener-9e510c6ed771e56f550be920c653b50d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf 2023-09-25 22:01:50,052 DEBUG [StoreOpener-9dd8ae177de2993cda34900abbf9df19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf 2023-09-25 22:01:50,055 INFO [StoreOpener-9e510c6ed771e56f550be920c653b50d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e510c6ed771e56f550be920c653b50d columnFamilyName cf 2023-09-25 22:01:50,055 INFO [StoreOpener-9dd8ae177de2993cda34900abbf9df19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd8ae177de2993cda34900abbf9df19 columnFamilyName cf 2023-09-25 22:01:50,058 INFO [StoreOpener-9e510c6ed771e56f550be920c653b50d-1] regionserver.HStore(310): Store=9e510c6ed771e56f550be920c653b50d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:50,058 INFO [StoreOpener-9dd8ae177de2993cda34900abbf9df19-1] regionserver.HStore(310): Store=9dd8ae177de2993cda34900abbf9df19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:01:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:01:50,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:01:50,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:50,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:01:50,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 9e510c6ed771e56f550be920c653b50d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67285166, jitterRate=0.0026271045207977295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:01:50,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 9dd8ae177de2993cda34900abbf9df19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63234879, jitterRate=-0.05772687494754791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:01:50,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 9e510c6ed771e56f550be920c653b50d: 2023-09-25 22:01:50,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 9dd8ae177de2993cda34900abbf9df19: 2023-09-25 22:01:50,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19., pid=16, masterSystemTime=1695679310039 2023-09-25 22:01:50,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d., pid=15, masterSystemTime=1695679310036 2023-09-25 22:01:50,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:50,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:50,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9e510c6ed771e56f550be920c653b50d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:50,081 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679310080"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679310080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679310080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679310080"}]},"ts":"1695679310080"} 2023-09-25 22:01:50,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:50,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:50,082 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9dd8ae177de2993cda34900abbf9df19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:50,084 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679310082"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679310082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679310082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679310082"}]},"ts":"1695679310082"} 2023-09-25 22:01:50,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-25 22:01:50,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 9e510c6ed771e56f550be920c653b50d, server=jenkins-hbase16.apache.org,40943,1695679301586 in 202 msec 2023-09-25 22:01:50,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-25 22:01:50,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 9dd8ae177de2993cda34900abbf9df19, server=jenkins-hbase16.apache.org,33807,1695679301636 in 203 msec 2023-09-25 22:01:50,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, ASSIGN in 367 msec 2023-09-25 22:01:50,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-25 22:01:50,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, ASSIGN in 372 msec 2023-09-25 22:01:50,102 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:01:50,102 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679310102"}]},"ts":"1695679310102"} 2023-09-25 22:01:50,104 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-25 22:01:50,145 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:01:50,150 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-25 22:01:50,156 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:50,161 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:50,165 DEBUG [hconnection-0x4d331773-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:50,169 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-25 22:01:50,177 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-25 22:01:50,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:50,219 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-25 22:01:50,219 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-25 22:01:50,219 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-25 22:01:50,219 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-25 22:01:50,219 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:01:50,236 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:01:50,236 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:01:50,236 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:01:50,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-25 22:01:50,238 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-25 22:01:50,238 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-25 22:01:50,238 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-25 22:01:50,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1510 sec 2023-09-25 22:01:50,539 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:01:50,539 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-25 22:01:50,540 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:01:50,540 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-25 22:01:50,540 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-25 22:01:50,540 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-25 22:01:50,540 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:01:50,540 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-25 22:01:50,541 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-25 22:01:50,541 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-25 22:01:51,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-25 22:01:51,218 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-25 22:01:51,222 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-25 22:01:51,223 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:51,225 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:01:51,249 DEBUG [hconnection-0x230246c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,252 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679311268 (current time:1695679311268). 2023-09-25 22:01:51,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:01:51,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x0f58e00c to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ed55ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:51,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,316 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f58e00c to 127.0.0.1:60419 2023-09-25 22:01:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:01:51,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x21033bbc to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:51,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d13584, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:51,338 DEBUG [hconnection-0x2caa638d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,339 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,348 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21033bbc to 127.0.0.1:60419 2023-09-25 22:01:51,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:01:51,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-25 22:01:51,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:01:51,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,389 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,390 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695679911390 2023-09-25 22:01:51,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-25 22:01:51,394 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:51,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-25 22:01:51,397 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:51,399 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695679911399 2023-09-25 22:01:51,399 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:01:51,399 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:01:51,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,430 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-25 22:01:51,431 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,432 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-25 22:01:51,432 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-25 22:01:51,433 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,433 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,466 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,466 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,466 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,466 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,469 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,473 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,474 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,474 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,472 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,474 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,474 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,475 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,475 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,475 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,475 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,485 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,485 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,494 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,494 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f0ba94[Count = 1] remaining members to acquire global barrier 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-25 22:01:51,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f0ba94[Count = 0] remaining members to acquire global barrier 2023-09-25 22:01:51,499 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-25 22:01:51,499 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,500 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:01:51,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-25 22:01:51,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:01:51,505 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:01:51,510 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,510 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,510 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,511 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,511 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:51,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,511 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:01:51,511 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:01:51,512 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:01:51,512 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:01:51,512 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:01:51,512 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:51,512 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:01:51,512 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:51,513 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. started... 2023-09-25 22:01:51,513 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. started... 2023-09-25 22:01:51,516 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e510c6ed771e56f550be920c653b50d: 2023-09-25 22:01:51,516 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd8ae177de2993cda34900abbf9df19: 2023-09-25 22:01:51,517 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,517 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,520 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:51,520 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:51,520 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:51,524 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:01:51,524 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:01:51,527 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:01:51,527 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:01:51,560 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. completed. 2023-09-25 22:01:51,561 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:51,561 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. completed. 2023-09-25 22:01:51,561 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:01:51,561 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:01:51,569 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:51,569 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,569 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,569 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:51,577 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:51,577 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:51,577 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:51,577 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:01:51,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-25 22:01:51,586 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-25 22:01:51,586 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:01:51,586 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:01:51,586 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,586 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,594 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,595 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,595 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,596 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,597 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,597 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,598 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,619 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:51,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:51,619 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:01:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,621 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,621 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,621 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,621 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,621 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:51,622 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,622 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,622 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,622 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:01:51,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-25 22:01:51,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,690 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-25 22:01:51,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695679311391Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695679311642 (+251 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695679311642Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695679311642Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695679311652 (+10 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695679311678 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695679311689 (+11 ms) 2023-09-25 22:01:51,692 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:51,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 300 msec 2023-09-25 22:01:51,705 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:01:51,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-25 22:01:51,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:01:51,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33807] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:01:51,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:01:51,730 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-25 22:01:51,730 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:51,730 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:01:51,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679311748 (current time:1695679311748). 2023-09-25 22:01:51,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:01:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x50846806 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:51,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ce44439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:51,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,766 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50846806 to 127.0.0.1:60419 2023-09-25 22:01:51,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:01:51,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x554512b3 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:01:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26728445, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:01:51,788 DEBUG [hconnection-0x2839d93e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,792 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:45654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:01:51,810 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:37724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:01:51,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x554512b3 to 127.0.0.1:60419 2023-09-25 22:01:51,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:01:51,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-25 22:01:51,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:01:51,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,818 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,819 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695679911819 2023-09-25 22:01:51,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-25 22:01:51,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-25 22:01:51,821 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:01:51,821 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:01:51,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:51,823 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-25 22:01:51,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-25 22:01:51,826 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:51,827 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695679911827 2023-09-25 22:01:51,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-25 22:01:51,845 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-25 22:01:51,845 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,846 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-25 22:01:51,846 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-25 22:01:51,847 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,847 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,852 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,852 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:51,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:51,852 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,853 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-25 22:01:51,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-25 22:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,854 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,858 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:01:51,859 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,860 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,860 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,860 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-25 22:01:51,860 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-25 22:01:51,860 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-25 22:01:51,869 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,869 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,877 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,877 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,877 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,877 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,878 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,878 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,879 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,878 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,879 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@359d34d5[Count = 1] remaining members to acquire global barrier 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-25 22:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@359d34d5[Count = 0] remaining members to acquire global barrier 2023-09-25 22:01:51,882 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-25 22:01:51,882 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,908 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,908 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,908 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,909 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:51,909 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:51,909 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:51,909 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. started... 2023-09-25 22:01:51,909 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:51,909 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:01:51,910 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:01:51,910 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. started... 2023-09-25 22:01:51,910 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e510c6ed771e56f550be920c653b50d 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-25 22:01:51,910 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9dd8ae177de2993cda34900abbf9df19 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-25 22:01:51,920 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:51,920 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:51,920 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:51,921 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:01:51,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-25 22:01:51,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:01:51,923 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:01:52,032 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54 2023-09-25 22:01:52,032 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052 2023-09-25 22:01:52,069 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/.tmp/cf/696f35940fba4e6eae363b2b887905e1 2023-09-25 22:01:52,070 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/.tmp/cf/9e711403ee9242a691d58f87d69f66c1 2023-09-25 22:01:52,081 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/.tmp/cf/696f35940fba4e6eae363b2b887905e1 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1 2023-09-25 22:01:52,081 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/.tmp/cf/9e711403ee9242a691d58f87d69f66c1 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1 2023-09-25 22:01:52,089 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1, entries=48, sequenceid=6, filesize=13.0 K 2023-09-25 22:01:52,089 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1, entries=2, sequenceid=6, filesize=5.2 K 2023-09-25 22:01:52,093 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9dd8ae177de2993cda34900abbf9df19 in 183ms, sequenceid=6, compaction requested=false 2023-09-25 22:01:52,093 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9e510c6ed771e56f550be920c653b50d in 183ms, sequenceid=6, compaction requested=false 2023-09-25 22:01:52,094 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-25 22:01:52,094 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd8ae177de2993cda34900abbf9df19: 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e510c6ed771e56f550be920c653b50d: 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:01:52,096 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:01:52,097 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1] hfiles 2023-09-25 22:01:52,097 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1] hfiles 2023-09-25 22:01:52,097 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1 for snapshot=snaptb0-testExportWithTargetName 2023-09-25 22:01:52,097 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1 for snapshot=snaptb0-testExportWithTargetName 2023-09-25 22:01:52,123 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. completed. 2023-09-25 22:01:52,123 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:01:52,123 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:01:52,123 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:01:52,123 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:01:52,123 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,123 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:52,123 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:01:52,124 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. completed. 2023-09-25 22:01:52,124 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:01:52,125 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:01:52,125 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:01:52,125 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-25 22:01:52,125 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-25 22:01:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:01:52,125 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:01:52,125 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-25 22:01:52,135 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:52,135 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,135 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:52,135 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:52,144 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-25 22:01:52,144 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:52,144 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:52,144 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-25 22:01:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:52,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:52,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:01:52,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-25 22:01:52,153 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-25 22:01:52,153 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:01:52,153 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:01:52,153 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-25 22:01:52,153 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,161 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:01:52,161 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,162 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:01:52,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,169 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:01:52,169 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-25 22:01:52,170 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,185 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:52,185 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:52,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:52,186 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,185 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,185 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:01:52,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-25 22:01:52,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:52,186 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:01:52,186 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:52,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:01:52,185 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:01:52,187 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,187 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,186 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:01:52,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-25 22:01:52,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:01:52,187 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:01:52,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:01:52,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,188 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54] mob files 2023-09-25 22:01:52,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052 2023-09-25 22:01:52,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54 2023-09-25 22:01:52,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-25 22:01:52,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-25 22:01:52,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,240 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-25 22:01:52,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695679311819Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695679312204 (+385 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695679312204Loading Region manifests for snaptb0-testExportWithTargetName at 1695679312205 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1695679312210 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695679312228 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695679312240 (+12 ms) 2023-09-25 22:01:52,242 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-25 22:01:52,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 423 msec 2023-09-25 22:01:52,425 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:01:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-25 22:01:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:01:52,429 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429 2023-09-25 22:01:52,429 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44421, tgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429, rawTgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:52,460 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:01:52,460 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-358806151_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-25 22:01:52,460 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-25 22:01:52,478 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-25 22:01:52,541 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:52,542 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:52,542 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:52,543 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,326 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-3664632116815241128.jar 2023-09-25 22:01:53,326 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,326 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,381 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-8727550845122791125.jar 2023-09-25 22:01:53,382 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,382 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,382 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,383 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,383 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,383 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:01:53,384 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:01:53,384 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:01:53,385 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:01:53,385 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:01:53,385 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:01:53,386 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:01:53,387 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:01:53,387 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:01:53,388 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:01:53,389 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:01:53,393 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:01:53,394 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:01:53,395 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:01:53,395 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:01:53,395 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:01:53,396 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:01:53,397 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:01:54,134 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:01:54,141 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-25 22:01:54,149 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-25 22:01:54,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:01:54,608 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:01:54,882 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0001_000001 (auth:SIMPLE) 2023-09-25 22:01:55,552 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:01:58,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0001_000001 (auth:SIMPLE) 2023-09-25 22:02:01,201 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0001_000001 (auth:SIMPLE) 2023-09-25 22:02:03,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0001_000001 (auth:SIMPLE) 2023-09-25 22:02:05,022 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:02:05,026 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:02:05,041 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-25 22:02:05,041 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:02:05,042 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:02:05,042 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-25 22:02:05,042 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-25 22:02:05,043 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-25 22:02:05,043 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/testExportWithTargetName 2023-09-25 22:02:05,043 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-25 22:02:05,043 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679312429/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-25 22:02:05,056 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-25 22:02:05,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportWithTargetName 2023-09-25 22:02:05,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,076 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679325076"}]},"ts":"1695679325076"} 2023-09-25 22:02:05,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-25 22:02:05,078 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-25 22:02:05,109 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-25 22:02:05,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, UNASSIGN}] 2023-09-25 22:02:05,115 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, UNASSIGN 2023-09-25 22:02:05,115 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, UNASSIGN 2023-09-25 22:02:05,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9e510c6ed771e56f550be920c653b50d, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:05,117 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9dd8ae177de2993cda34900abbf9df19, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:05,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679325116"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679325116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679325116"}]},"ts":"1695679325116"} 2023-09-25 22:02:05,117 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679325116"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679325116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679325116"}]},"ts":"1695679325116"} 2023-09-25 22:02:05,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 9e510c6ed771e56f550be920c653b50d, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:05,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 9dd8ae177de2993cda34900abbf9df19, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:02:05,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-25 22:02:05,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:02:05,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 9dd8ae177de2993cda34900abbf9df19, disabling compactions & flushes 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 9e510c6ed771e56f550be920c653b50d, disabling compactions & flushes 2023-09-25 22:02:05,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. after waiting 0 ms 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:02:05,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. after waiting 0 ms 2023-09-25 22:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:02:05,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:05,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:05,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:05,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:05,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d. 2023-09-25 22:02:05,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19. 2023-09-25 22:02:05,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 9e510c6ed771e56f550be920c653b50d: 2023-09-25 22:02:05,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 9dd8ae177de2993cda34900abbf9df19: 2023-09-25 22:02:05,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:02:05,307 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9dd8ae177de2993cda34900abbf9df19, regionState=CLOSED 2023-09-25 22:02:05,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 9e510c6ed771e56f550be920c653b50d 2023-09-25 22:02:05,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679325307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679325307"}]},"ts":"1695679325307"} 2023-09-25 22:02:05,308 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9e510c6ed771e56f550be920c653b50d, regionState=CLOSED 2023-09-25 22:02:05,309 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695679325308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679325308"}]},"ts":"1695679325308"} 2023-09-25 22:02:05,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-25 22:02:05,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 9dd8ae177de2993cda34900abbf9df19, server=jenkins-hbase16.apache.org,33807,1695679301636 in 190 msec 2023-09-25 22:02:05,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-25 22:02:05,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 9e510c6ed771e56f550be920c653b50d, server=jenkins-hbase16.apache.org,40943,1695679301586 in 192 msec 2023-09-25 22:02:05,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9dd8ae177de2993cda34900abbf9df19, UNASSIGN in 201 msec 2023-09-25 22:02:05,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-25 22:02:05,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9e510c6ed771e56f550be920c653b50d, UNASSIGN in 202 msec 2023-09-25 22:02:05,317 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679325317"}]},"ts":"1695679325317"} 2023-09-25 22:02:05,319 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-25 22:02:05,326 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-25 22:02:05,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 264 msec 2023-09-25 22:02:05,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-25 22:02:05,380 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-25 22:02:05,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportWithTargetName 2023-09-25 22:02:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,395 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-25 22:02:05,399 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,401 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-25 22:02:05,405 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:02:05,408 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:02:05,411 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/recovered.edits] 2023-09-25 22:02:05,411 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/recovered.edits] 2023-09-25 22:02:05,418 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,418 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,418 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-25 22:02:05,419 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-25 22:02:05,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-25 22:02:05,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/cf/696f35940fba4e6eae363b2b887905e1 2023-09-25 22:02:05,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-25 22:02:05,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/cf/9e711403ee9242a691d58f87d69f66c1 2023-09-25 22:02:05,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d/recovered.edits/9.seqid 2023-09-25 22:02:05,423 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19/recovered.edits/9.seqid 2023-09-25 22:02:05,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9e510c6ed771e56f550be920c653b50d 2023-09-25 22:02:05,424 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportWithTargetName/9dd8ae177de2993cda34900abbf9df19 2023-09-25 22:02:05,424 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-25 22:02:05,424 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-25 22:02:05,425 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:05,427 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:05,426 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:05,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-25 22:02:05,432 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092510bc16be2e3d43298c5b19db1b4d4052 2023-09-25 22:02:05,434 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309252cb648748f8a4419999d8b02e98a6d54 2023-09-25 22:02:05,434 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-25 22:02:05,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,457 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-25 22:02:05,460 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-25 22:02:05,462 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,462 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-25 22:02:05,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679325462"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:05,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679325462"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:05,465 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:02:05,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9dd8ae177de2993cda34900abbf9df19, NAME => 'testtb-testExportWithTargetName,,1695679309085.9dd8ae177de2993cda34900abbf9df19.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9e510c6ed771e56f550be920c653b50d, NAME => 'testtb-testExportWithTargetName,1,1695679309085.9e510c6ed771e56f550be920c653b50d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:02:05,466 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-25 22:02:05,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679325466"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:05,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-25 22:02:05,478 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-25 22:02:05,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-09-25 22:02:05,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-25 22:02:05,533 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-25 22:02:05,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-25 22:02:05,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-25 22:02:05,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportWithTargetName" 2023-09-25 22:02:05,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-25 22:02:05,593 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:34969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:32835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:39003 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:50602 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:39996 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:57762 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_928807846_1 at /127.0.0.1:39990 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_928807846_1 at /127.0.0.1:57740 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 121) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4344 (was 5035) 2023-09-25 22:02:05,593 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-25 22:02:05,609 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=168, AvailableMemoryMB=4344 2023-09-25 22:02:05,609 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-25 22:02:05,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:02:05,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:05,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:02:05,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-25 22:02:05,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-25 22:02:05,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:02:05,623 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:05,623 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:05,624 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 empty. 2023-09-25 22:02:05,624 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a empty. 2023-09-25 22:02:05,624 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:05,624 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:05,624 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-25 22:02:05,636 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-25 22:02:05,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 75d2e9f519bdf5ead4c43bc6284a6c91, NAME => 'testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:05,638 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d2b28423c2a5082197ddfbaccef0367a, NAME => 'testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:05,656 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:05,658 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 75d2e9f519bdf5ead4c43bc6284a6c91, disabling compactions & flushes 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d2b28423c2a5082197ddfbaccef0367a, disabling compactions & flushes 2023-09-25 22:02:05,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:05,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. after waiting 0 ms 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. after waiting 0 ms 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:05,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:05,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 75d2e9f519bdf5ead4c43bc6284a6c91: 2023-09-25 22:02:05,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d2b28423c2a5082197ddfbaccef0367a: 2023-09-25 22:02:05,662 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:02:05,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679325663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679325663"}]},"ts":"1695679325663"} 2023-09-25 22:02:05,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679325663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679325663"}]},"ts":"1695679325663"} 2023-09-25 22:02:05,666 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:02:05,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:02:05,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679325667"}]},"ts":"1695679325667"} 2023-09-25 22:02:05,669 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-25 22:02:05,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:02:05,686 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:02:05,686 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:02:05,686 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:02:05,686 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:02:05,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, ASSIGN}] 2023-09-25 22:02:05,690 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, ASSIGN 2023-09-25 22:02:05,690 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, ASSIGN 2023-09-25 22:02:05,691 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:02:05,691 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:02:05,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-25 22:02:05,842 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:02:05,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=75d2e9f519bdf5ead4c43bc6284a6c91, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:05,844 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d2b28423c2a5082197ddfbaccef0367a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:05,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679325844"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679325844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679325844"}]},"ts":"1695679325844"} 2023-09-25 22:02:05,844 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679325844"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679325844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679325844"}]},"ts":"1695679325844"} 2023-09-25 22:02:05,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 75d2e9f519bdf5ead4c43bc6284a6c91, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:05,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure d2b28423c2a5082197ddfbaccef0367a, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:02:05,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-25 22:02:06,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:06,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:06,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2b28423c2a5082197ddfbaccef0367a, NAME => 'testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:02:06,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75d2e9f519bdf5ead4c43bc6284a6c91, NAME => 'testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:02:06,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. service=AccessControlService 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. service=AccessControlService 2023-09-25 22:02:06,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:06,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,006 INFO [StoreOpener-75d2e9f519bdf5ead4c43bc6284a6c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,006 INFO [StoreOpener-d2b28423c2a5082197ddfbaccef0367a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,007 DEBUG [StoreOpener-75d2e9f519bdf5ead4c43bc6284a6c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf 2023-09-25 22:02:06,007 DEBUG [StoreOpener-d2b28423c2a5082197ddfbaccef0367a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf 2023-09-25 22:02:06,007 DEBUG [StoreOpener-75d2e9f519bdf5ead4c43bc6284a6c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf 2023-09-25 22:02:06,007 DEBUG [StoreOpener-d2b28423c2a5082197ddfbaccef0367a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf 2023-09-25 22:02:06,008 INFO [StoreOpener-d2b28423c2a5082197ddfbaccef0367a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2b28423c2a5082197ddfbaccef0367a columnFamilyName cf 2023-09-25 22:02:06,008 INFO [StoreOpener-75d2e9f519bdf5ead4c43bc6284a6c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75d2e9f519bdf5ead4c43bc6284a6c91 columnFamilyName cf 2023-09-25 22:02:06,009 INFO [StoreOpener-75d2e9f519bdf5ead4c43bc6284a6c91-1] regionserver.HStore(310): Store=75d2e9f519bdf5ead4c43bc6284a6c91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:06,009 INFO [StoreOpener-d2b28423c2a5082197ddfbaccef0367a-1] regionserver.HStore(310): Store=d2b28423c2a5082197ddfbaccef0367a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:06,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:06,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:06,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:06,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:06,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened d2b28423c2a5082197ddfbaccef0367a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73779294, jitterRate=0.09939715266227722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:06,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 75d2e9f519bdf5ead4c43bc6284a6c91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70133507, jitterRate=0.04507069289684296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:06,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for d2b28423c2a5082197ddfbaccef0367a: 2023-09-25 22:02:06,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 75d2e9f519bdf5ead4c43bc6284a6c91: 2023-09-25 22:02:06,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91., pid=30, masterSystemTime=1695679325999 2023-09-25 22:02:06,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a., pid=31, masterSystemTime=1695679325999 2023-09-25 22:02:06,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:06,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:06,022 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=75d2e9f519bdf5ead4c43bc6284a6c91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:06,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:06,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:06,022 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679326022"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679326022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679326022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679326022"}]},"ts":"1695679326022"} 2023-09-25 22:02:06,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d2b28423c2a5082197ddfbaccef0367a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:06,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679326023"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679326023"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679326023"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679326023"}]},"ts":"1695679326023"} 2023-09-25 22:02:06,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-25 22:02:06,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 75d2e9f519bdf5ead4c43bc6284a6c91, server=jenkins-hbase16.apache.org,40943,1695679301586 in 182 msec 2023-09-25 22:02:06,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-25 22:02:06,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure d2b28423c2a5082197ddfbaccef0367a, server=jenkins-hbase16.apache.org,33807,1695679301636 in 182 msec 2023-09-25 22:02:06,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, ASSIGN in 345 msec 2023-09-25 22:02:06,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-25 22:02:06,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, ASSIGN in 347 msec 2023-09-25 22:02:06,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:02:06,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679326038"}]},"ts":"1695679326038"} 2023-09-25 22:02:06,040 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-25 22:02:06,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-25 22:02:06,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:02:06,253 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-25 22:02:06,255 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:02:06,379 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:06,379 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:06,379 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:06,379 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:06,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:06,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:06,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:06,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:06,512 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 897 msec 2023-09-25 22:02:06,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-25 22:02:06,726 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-25 22:02:06,729 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-25 22:02:06,729 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:06,731 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:06,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:06,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679326747 (current time:1695679326747). 2023-09-25 22:02:06,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:06,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x19910957 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:07,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b2a82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:07,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:07,153 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:48930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:07,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19910957 to 127.0.0.1:60419 2023-09-25 22:02:07,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:07,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x1288eea2 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:07,649 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-25 22:02:09,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3429615, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:09,696 DEBUG [hconnection-0x5886a3c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:09,698 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:48942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:09,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:09,704 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1288eea2 to 127.0.0.1:60419 2023-09-25 22:02:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:02:09,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:09,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:09,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:09,710 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:09,711 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695679929711 2023-09-25 22:02:09,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-25 22:02:09,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:09,712 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:09,712 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:09,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:09,714 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:09,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-25 22:02:09,718 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:09,721 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695679929721 2023-09-25 22:02:09,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,743 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-25 22:02:09,743 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:09,744 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-25 22:02:09,744 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-25 22:02:09,745 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,745 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,751 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,751 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,751 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,751 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,752 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,752 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,752 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,752 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:09,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,753 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:09,753 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:09,755 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:09,753 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:09,755 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:09,755 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:09,755 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:09,756 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:09,756 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:09,757 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:09,757 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:09,757 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:09,757 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:09,757 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:09,767 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,767 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:09,801 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:09,802 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:09,801 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,802 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57103180[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0001_000001 (auth:SIMPLE) 2023-09-25 22:02:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:09,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-25 22:02:09,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57103180[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:09,811 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-25 22:02:09,811 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,813 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:09,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:02:09,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:09,814 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:09,826 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,827 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,827 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:09,827 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:09,827 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:09,827 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. started... 2023-09-25 22:02:09,827 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. started... 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:09,827 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:09,827 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75d2e9f519bdf5ead4c43bc6284a6c91: 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2b28423c2a5082197ddfbaccef0367a: 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:09,829 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:09,834 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:09,834 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:09,835 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:09,845 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. completed. 2023-09-25 22:02:09,845 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:09,845 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:09,845 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:09,845 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,845 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:09,845 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:09,847 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. completed. 2023-09-25 22:02:09,847 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:09,847 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:09,847 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:09,847 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,847 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:09,847 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:09,851 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:09,851 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,851 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:09,851 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:09,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:09,859 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,859 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:09,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:09,860 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:09,860 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:09,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:09,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:09,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:09,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:09,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:09,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:02:09,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-25 22:02:09,867 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-25 22:02:09,867 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:09,867 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:09,867 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,867 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:09,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,877 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,876 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:09,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,877 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,878 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,884 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,884 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,884 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:09,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-25 22:02:09,893 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:09,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:09,893 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:09,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:02:09,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-25 22:02:09,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,941 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:09,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695679329711Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695679329903 (+192 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695679329903Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695679329903Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695679329907 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695679329931 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695679329940 (+9 ms) 2023-09-25 22:02:09,943 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:09,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 231 msec 2023-09-25 22:02:10,014 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:10,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:02:10,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:10,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:10,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33807] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:10,027 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-25 22:02:10,027 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:10,027 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:10,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:10,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679330046 (current time:1695679330046). 2023-09-25 22:02:10,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:10,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x080e9d80 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:10,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d90587d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:10,065 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:48952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:10,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x080e9d80 to 127.0.0.1:60419 2023-09-25 22:02:10,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:10,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x245f3c14 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:10,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@470dbf47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:10,087 DEBUG [hconnection-0x28027ac5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:10,088 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:48968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:10,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:10,096 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:10,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x245f3c14 to 127.0.0.1:60419 2023-09-25 22:02:10,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:10,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:02:10,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:10,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:10,103 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:10,104 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695679930104 2023-09-25 22:02:10,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:02:10,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-25 22:02:10,106 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:10,106 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:10,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:10,108 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:02:10,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-25 22:02:10,111 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:10,112 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695679930112 2023-09-25 22:02:10,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-25 22:02:10,123 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-25 22:02:10,123 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:10,124 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-25 22:02:10,124 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-25 22:02:10,125 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,125 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,135 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,135 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,135 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,135 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,136 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:10,137 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:10,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-25 22:02:10,137 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:10,137 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-25 22:02:10,138 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:10,138 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:10,137 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:10,138 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:10,139 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:10,139 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:10,138 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:10,139 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:10,140 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-25 22:02:10,140 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-25 22:02:10,140 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-25 22:02:10,151 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,151 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,160 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,160 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c515ec[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:10,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-25 22:02:10,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c515ec[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:10,163 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-25 22:02:10,164 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,168 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:10,168 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:02:10,168 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:10,169 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:10,168 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:10,169 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:10,168 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,169 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. started... 2023-09-25 22:02:10,169 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:10,169 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:10,169 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:10,169 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:10,169 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:10,169 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. started... 2023-09-25 22:02:10,169 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d2b28423c2a5082197ddfbaccef0367a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-25 22:02:10,169 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 75d2e9f519bdf5ead4c43bc6284a6c91 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-25 22:02:10,176 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:10,176 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:10,176 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:10,196 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3 2023-09-25 22:02:10,201 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d 2023-09-25 22:02:10,206 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:10,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:02:10,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:10,208 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:10,223 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/.tmp/cf/17ffb1df7c4f4063b5f05e8503f9df70 2023-09-25 22:02:10,227 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/.tmp/cf/7d7d7b11e5f14914bf6ed3fea43115f3 2023-09-25 22:02:10,233 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/.tmp/cf/17ffb1df7c4f4063b5f05e8503f9df70 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70 2023-09-25 22:02:10,234 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/.tmp/cf/7d7d7b11e5f14914bf6ed3fea43115f3 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3 2023-09-25 22:02:10,240 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70, entries=1, sequenceid=6, filesize=5.1 K 2023-09-25 22:02:10,241 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3, entries=49, sequenceid=6, filesize=13.2 K 2023-09-25 22:02:10,242 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for d2b28423c2a5082197ddfbaccef0367a in 73ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d2b28423c2a5082197ddfbaccef0367a: 2023-09-25 22:02:10,244 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 75d2e9f519bdf5ead4c43bc6284a6c91 in 75ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75d2e9f519bdf5ead4c43bc6284a6c91: 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3] hfiles 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3 for snapshot=snaptb0-testExportFileSystemState 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70] hfiles 2023-09-25 22:02:10,244 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70 for snapshot=snaptb0-testExportFileSystemState 2023-09-25 22:02:10,270 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. completed. 2023-09-25 22:02:10,270 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. completed. 2023-09-25 22:02:10,270 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:10,270 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:10,271 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,270 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:10,271 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-25 22:02:10,271 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:10,271 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:10,304 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:10,304 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:10,304 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,304 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:10,318 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-25 22:02:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:10,318 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:10,318 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,318 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-25 22:02:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:10,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-25 22:02:10,326 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-25 22:02:10,326 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:10,326 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:10,326 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-25 22:02:10,326 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,335 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,336 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:10,336 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,337 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:10,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,340 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:10,340 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-25 22:02:10,341 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:10,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:10,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-25 22:02:10,352 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:10,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-25 22:02:10,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:10,352 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,354 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3] mob files 2023-09-25 22:02:10,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d 2023-09-25 22:02:10,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3 2023-09-25 22:02:10,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:10,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-25 22:02:10,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,408 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:02:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:10,410 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-25 22:02:10,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-25 22:02:10,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,444 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695679330104Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695679330401 (+297 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695679330401Loading Region manifests for snaptb0-testExportFileSystemState at 1695679330402 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1695679330416 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695679330432 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695679330443 (+11 ms) 2023-09-25 22:02:10,446 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-25 22:02:10,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 340 msec 2023-09-25 22:02:10,710 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:10,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:02:10,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:10,712 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712 2023-09-25 22:02:10,712 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44421, tgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712, rawTgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:10,731 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:10,731 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1947410420_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,732 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-25 22:02:10,745 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-25 22:02:10,774 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:10,774 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:10,775 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:10,775 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:10,938 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:02:11,523 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-6436336793391945231.jar 2023-09-25 22:02:11,524 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,524 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,580 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-350482964179012035.jar 2023-09-25 22:02:11,580 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,580 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,581 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,581 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,581 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,582 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:11,582 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:02:11,582 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:02:11,583 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:02:11,583 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:02:11,583 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:02:11,584 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:02:11,584 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:02:11,584 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:02:11,585 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:02:11,585 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:02:11,586 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:11,586 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:11,587 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:11,587 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:11,587 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:11,588 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:11,588 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:12,036 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:02:12,039 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-25 22:02:12,042 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-25 22:02:12,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:12,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:12,810 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0002_000001 (auth:SIMPLE) 2023-09-25 22:02:16,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0002_000001 (auth:SIMPLE) 2023-09-25 22:02:18,327 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0002_000001 (auth:SIMPLE) 2023-09-25 22:02:20,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0002_000001 (auth:SIMPLE) 2023-09-25 22:02:22,337 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:02:22,338 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:02:22,345 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-25 22:02:22,345 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:02:22,346 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:02:22,346 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-25 22:02:22,346 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-25 22:02:22,346 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-25 22:02:22,346 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-25 22:02:22,347 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-25 22:02:22,347 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679330712/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-25 22:02:22,355 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-25 22:02:22,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemState 2023-09-25 22:02:22,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-25 22:02:22,361 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679342361"}]},"ts":"1695679342361"} 2023-09-25 22:02:22,363 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-25 22:02:22,409 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-25 22:02:22,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, UNASSIGN}] 2023-09-25 22:02:22,412 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, UNASSIGN 2023-09-25 22:02:22,413 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, UNASSIGN 2023-09-25 22:02:22,413 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d2b28423c2a5082197ddfbaccef0367a, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:22,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679342413"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679342413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679342413"}]},"ts":"1695679342413"} 2023-09-25 22:02:22,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=75d2e9f519bdf5ead4c43bc6284a6c91, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:22,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679342414"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679342414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679342414"}]},"ts":"1695679342414"} 2023-09-25 22:02:22,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure d2b28423c2a5082197ddfbaccef0367a, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:02:22,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 75d2e9f519bdf5ead4c43bc6284a6c91, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:22,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-25 22:02:22,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:22,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing d2b28423c2a5082197ddfbaccef0367a, disabling compactions & flushes 2023-09-25 22:02:22,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:22,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:22,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. after waiting 0 ms 2023-09-25 22:02:22,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:22,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:22,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 75d2e9f519bdf5ead4c43bc6284a6c91, disabling compactions & flushes 2023-09-25 22:02:22,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:22,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:22,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. after waiting 0 ms 2023-09-25 22:02:22,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:22,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:22,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:22,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:22,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:22,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91. 2023-09-25 22:02:22,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a. 2023-09-25 22:02:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for d2b28423c2a5082197ddfbaccef0367a: 2023-09-25 22:02:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 75d2e9f519bdf5ead4c43bc6284a6c91: 2023-09-25 22:02:22,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:22,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=75d2e9f519bdf5ead4c43bc6284a6c91, regionState=CLOSED 2023-09-25 22:02:22,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:22,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679342590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679342590"}]},"ts":"1695679342590"} 2023-09-25 22:02:22,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d2b28423c2a5082197ddfbaccef0367a, regionState=CLOSED 2023-09-25 22:02:22,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695679342591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679342591"}]},"ts":"1695679342591"} 2023-09-25 22:02:22,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-25 22:02:22,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 75d2e9f519bdf5ead4c43bc6284a6c91, server=jenkins-hbase16.apache.org,40943,1695679301586 in 175 msec 2023-09-25 22:02:22,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-25 22:02:22,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure d2b28423c2a5082197ddfbaccef0367a, server=jenkins-hbase16.apache.org,33807,1695679301636 in 178 msec 2023-09-25 22:02:22,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=75d2e9f519bdf5ead4c43bc6284a6c91, UNASSIGN in 185 msec 2023-09-25 22:02:22,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-25 22:02:22,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d2b28423c2a5082197ddfbaccef0367a, UNASSIGN in 187 msec 2023-09-25 22:02:22,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679342600"}]},"ts":"1695679342600"} 2023-09-25 22:02:22,602 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-25 22:02:22,609 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-25 22:02:22,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 255 msec 2023-09-25 22:02:22,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-25 22:02:22,663 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-25 22:02:22,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemState 2023-09-25 22:02:22,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,667 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-25 22:02:22,669 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,670 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-25 22:02:22,674 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:22,674 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:22,677 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/recovered.edits] 2023-09-25 22:02:22,677 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/recovered.edits] 2023-09-25 22:02:22,682 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/cf/7d7d7b11e5f14914bf6ed3fea43115f3 2023-09-25 22:02:22,683 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/cf/17ffb1df7c4f4063b5f05e8503f9df70 2023-09-25 22:02:22,684 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,684 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,685 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,685 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-25 22:02:22,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-25 22:02:22,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-25 22:02:22,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-25 22:02:22,687 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91/recovered.edits/9.seqid 2023-09-25 22:02:22,687 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a/recovered.edits/9.seqid 2023-09-25 22:02:22,688 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/75d2e9f519bdf5ead4c43bc6284a6c91 2023-09-25 22:02:22,688 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemState/d2b28423c2a5082197ddfbaccef0367a 2023-09-25 22:02:22,688 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-25 22:02:22,688 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-25 22:02:22,689 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:22,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:22,693 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230925093ddd11760f4711af1748e9cfe06c9d 2023-09-25 22:02:22,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-25 22:02:22,694 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230925e40c122a85e141118f6ae0a9692e89a3 2023-09-25 22:02:22,695 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-25 22:02:22,697 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,700 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-25 22:02:22,702 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-25 22:02:22,704 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,704 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-25 22:02:22,704 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679342704"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:22,704 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679342704"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:22,709 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:02:22,709 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75d2e9f519bdf5ead4c43bc6284a6c91, NAME => 'testtb-testExportFileSystemState,,1695679325611.75d2e9f519bdf5ead4c43bc6284a6c91.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d2b28423c2a5082197ddfbaccef0367a, NAME => 'testtb-testExportFileSystemState,1,1695679325611.d2b28423c2a5082197ddfbaccef0367a.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:02:22,709 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-25 22:02:22,709 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679342709"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:22,711 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-25 22:02:22,718 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-25 22:02:22,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 54 msec 2023-09-25 22:02:22,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-25 22:02:22,795 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-25 22:02:22,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-25 22:02:22,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-25 22:02:22,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemState" 2023-09-25 22:02:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-25 22:02:22,843 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 757) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1545487910_1 at /127.0.0.1:44048 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:39101 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:34356 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1545487910_1 at /127.0.0.1:34336 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:44078 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:44124 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 157) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4228 (was 4344) 2023-09-25 22:02:22,844 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-25 22:02:22,859 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=168, AvailableMemoryMB=4228 2023-09-25 22:02:22,859 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-25 22:02:22,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:02:22,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:22,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:02:22,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-25 22:02:22,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:02:22,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-25 22:02:22,868 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:22,868 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:22,868 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 empty. 2023-09-25 22:02:22,869 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 empty. 2023-09-25 22:02:22,869 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:22,869 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:22,869 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-25 22:02:22,885 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-25 22:02:22,886 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 73efb43b3f4ff6185c88c3a016b28028, NAME => 'testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:22,886 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => d7f20f8ae5dd109b8e10bf12ec766ab5, NAME => 'testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:22,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:22,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 73efb43b3f4ff6185c88c3a016b28028, disabling compactions & flushes 2023-09-25 22:02:22,915 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:22,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:22,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. after waiting 0 ms 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:22,916 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 73efb43b3f4ff6185c88c3a016b28028: 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing d7f20f8ae5dd109b8e10bf12ec766ab5, disabling compactions & flushes 2023-09-25 22:02:22,916 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. after waiting 0 ms 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:22,916 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:22,916 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for d7f20f8ae5dd109b8e10bf12ec766ab5: 2023-09-25 22:02:22,918 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:02:22,919 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679342919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679342919"}]},"ts":"1695679342919"} 2023-09-25 22:02:22,919 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679342919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679342919"}]},"ts":"1695679342919"} 2023-09-25 22:02:22,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:02:22,923 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:02:22,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679342923"}]},"ts":"1695679342923"} 2023-09-25 22:02:22,925 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-25 22:02:22,943 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:02:22,944 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:02:22,944 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:02:22,944 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:02:22,944 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:02:22,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, ASSIGN}] 2023-09-25 22:02:22,948 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, ASSIGN 2023-09-25 22:02:22,948 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, ASSIGN 2023-09-25 22:02:22,949 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,37003,1695679301677; forceNewPlan=false, retain=false 2023-09-25 22:02:22,949 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:02:22,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-25 22:02:23,099 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:02:23,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=73efb43b3f4ff6185c88c3a016b28028, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d7f20f8ae5dd109b8e10bf12ec766ab5, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,102 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679343102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679343102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679343102"}]},"ts":"1695679343102"} 2023-09-25 22:02:23,102 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679343102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679343102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679343102"}]},"ts":"1695679343102"} 2023-09-25 22:02:23,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 73efb43b3f4ff6185c88c3a016b28028, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:02:23,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure d7f20f8ae5dd109b8e10bf12ec766ab5, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:23,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-25 22:02:23,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73efb43b3f4ff6185c88c3a016b28028, NAME => 'testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:02:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7f20f8ae5dd109b8e10bf12ec766ab5, NAME => 'testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:02:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. service=AccessControlService 2023-09-25 22:02:23,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. service=AccessControlService 2023-09-25 22:02:23,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:23,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,277 INFO [StoreOpener-d7f20f8ae5dd109b8e10bf12ec766ab5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,277 INFO [StoreOpener-73efb43b3f4ff6185c88c3a016b28028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,278 DEBUG [StoreOpener-73efb43b3f4ff6185c88c3a016b28028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf 2023-09-25 22:02:23,278 DEBUG [StoreOpener-73efb43b3f4ff6185c88c3a016b28028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf 2023-09-25 22:02:23,278 DEBUG [StoreOpener-d7f20f8ae5dd109b8e10bf12ec766ab5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf 2023-09-25 22:02:23,278 DEBUG [StoreOpener-d7f20f8ae5dd109b8e10bf12ec766ab5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf 2023-09-25 22:02:23,279 INFO [StoreOpener-73efb43b3f4ff6185c88c3a016b28028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73efb43b3f4ff6185c88c3a016b28028 columnFamilyName cf 2023-09-25 22:02:23,279 INFO [StoreOpener-d7f20f8ae5dd109b8e10bf12ec766ab5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7f20f8ae5dd109b8e10bf12ec766ab5 columnFamilyName cf 2023-09-25 22:02:23,280 INFO [StoreOpener-73efb43b3f4ff6185c88c3a016b28028-1] regionserver.HStore(310): Store=73efb43b3f4ff6185c88c3a016b28028/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:23,280 INFO [StoreOpener-d7f20f8ae5dd109b8e10bf12ec766ab5-1] regionserver.HStore(310): Store=d7f20f8ae5dd109b8e10bf12ec766ab5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:23,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:23,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:23,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:23,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 73efb43b3f4ff6185c88c3a016b28028; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64943564, jitterRate=-0.03226548433303833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:23,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened d7f20f8ae5dd109b8e10bf12ec766ab5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64419153, jitterRate=-0.04007981717586517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:23,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 73efb43b3f4ff6185c88c3a016b28028: 2023-09-25 22:02:23,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for d7f20f8ae5dd109b8e10bf12ec766ab5: 2023-09-25 22:02:23,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028., pid=45, masterSystemTime=1695679343258 2023-09-25 22:02:23,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5., pid=46, masterSystemTime=1695679343263 2023-09-25 22:02:23,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=73efb43b3f4ff6185c88c3a016b28028, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:23,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:23,291 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679343290"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679343290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679343290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679343290"}]},"ts":"1695679343290"} 2023-09-25 22:02:23,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d7f20f8ae5dd109b8e10bf12ec766ab5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679343291"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679343291"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679343291"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679343291"}]},"ts":"1695679343291"} 2023-09-25 22:02:23,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-25 22:02:23,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 73efb43b3f4ff6185c88c3a016b28028, server=jenkins-hbase16.apache.org,37003,1695679301677 in 188 msec 2023-09-25 22:02:23,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-25 22:02:23,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure d7f20f8ae5dd109b8e10bf12ec766ab5, server=jenkins-hbase16.apache.org,40943,1695679301586 in 185 msec 2023-09-25 22:02:23,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, ASSIGN in 351 msec 2023-09-25 22:02:23,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-25 22:02:23,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, ASSIGN in 352 msec 2023-09-25 22:02:23,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:02:23,299 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679343299"}]},"ts":"1695679343299"} 2023-09-25 22:02:23,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-25 22:02:23,335 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:02:23,336 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-25 22:02:23,339 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-25 22:02:23,350 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:23,350 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:23,350 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:23,350 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:23,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:23,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:23,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:23,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:23,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 499 msec 2023-09-25 22:02:23,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-25 22:02:23,473 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-25 22:02:23,480 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-25 22:02:23,480 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,483 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:23,494 DEBUG [hconnection-0x230246c-shared-pool-22] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,499 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679343506 (current time:1695679343506). 2023-09-25 22:02:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:23,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x35974b84 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78a25eb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:23,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,523 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35974b84 to 127.0.0.1:60419 2023-09-25 22:02:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:23,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x24adaaa8 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:23,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2be91ed2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:23,545 DEBUG [hconnection-0x4154b2e5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,549 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,558 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24adaaa8 to 127.0.0.1:60419 2023-09-25 22:02:23,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:23,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-25 22:02:23,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:23,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,564 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,565 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695679943565 2023-09-25 22:02:23,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-25 22:02:23,567 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:23,567 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:23,571 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:23,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-09-25 22:02:23,574 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:23,575 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695679943575 2023-09-25 22:02:23,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,587 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-25 22:02:23,587 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,588 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-25 22:02:23,589 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-25 22:02:23,589 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,589 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,592 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,592 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,592 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,592 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,593 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,593 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,593 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,593 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:23,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,594 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,594 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,594 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,595 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,595 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,595 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,594 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,597 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,599 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,599 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,595 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,599 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,600 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,600 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,600 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,609 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,609 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,617 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,617 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,617 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,618 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,617 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,618 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,618 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,618 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,618 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aa2b67d[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-25 22:02:23,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aa2b67d[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:23,624 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-25 22:02:23,624 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,660 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,661 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:23,661 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:23,661 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:23,661 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:23,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,661 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,662 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:23,662 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,661 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:23,662 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:23,662 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:23,662 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:23,662 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. started... 2023-09-25 22:02:23,663 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,663 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:23,663 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. started... 2023-09-25 22:02:23,662 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:23,663 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73efb43b3f4ff6185c88c3a016b28028: 2023-09-25 22:02:23,665 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d7f20f8ae5dd109b8e10bf12ec766ab5: 2023-09-25 22:02:23,666 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,666 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,666 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:23,666 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:23,668 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:23,668 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:23,669 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:23,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-25 22:02:23,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:23,670 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:23,676 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:23,676 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:23,676 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:23,682 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. completed. 2023-09-25 22:02:23,682 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:23,682 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. completed. 2023-09-25 22:02:23,682 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:23,682 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:23,682 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:23,683 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:23,692 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:23,692 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:23,692 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:23,692 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,692 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,694 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,694 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:23,694 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:23,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-25 22:02:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:02:23,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-25 22:02:23,710 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-25 22:02:23,710 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:23,710 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:23,711 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,711 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,717 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,718 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,718 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,719 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,719 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,721 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,721 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,722 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,733 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,733 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,733 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,733 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-25 22:02:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,734 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:23,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:23,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:23,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,734 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:23,738 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,738 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,738 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,738 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,738 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,739 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,739 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:02:23,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-25 22:02:23,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:23,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695679343565Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695679343749 (+184 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695679343749Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695679343750 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695679343753 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695679343762 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695679343771 (+9 ms) 2023-09-25 22:02:23,774 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:23,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 208 msec 2023-09-25 22:02:23,871 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:23,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-25 22:02:23,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:23,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37003] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:23,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:23,884 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-25 22:02:23,884 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:23,884 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:23,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679343895 (current time:1695679343895). 2023-09-25 22:02:23,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:23,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x7d39c779 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79383b69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:23,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,913 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d39c779 to 127.0.0.1:60419 2023-09-25 22:02:23,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:23,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x27d6295c to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:23,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e730d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:23,929 DEBUG [hconnection-0x2c3cb256-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,933 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:23,939 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:38416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:23,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27d6295c to 127.0.0.1:60419 2023-09-25 22:02:23,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:23,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-25 22:02:23,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:23,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,945 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,946 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695679943946 2023-09-25 22:02:23,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-25 22:02:23,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-25 22:02:23,948 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:23,948 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:23,949 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-25 22:02:23,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:23,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-25 22:02:23,952 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:23,952 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695679943952 2023-09-25 22:02:23,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-25 22:02:23,962 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-25 22:02:23,962 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,963 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-25 22:02:23,963 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-25 22:02:23,964 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,964 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,967 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,967 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,967 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,967 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,967 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-25 22:02:23,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-25 22:02:23,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-25 22:02:23,969 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,969 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,969 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,969 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,970 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-25 22:02:23,971 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:23,972 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-25 22:02:23,972 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-25 22:02:23,972 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-25 22:02:23,976 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,976 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,976 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,976 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:23,984 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:23,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a9057a6[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:23,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:23,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:23,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:23,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:23,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:23,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-25 22:02:23,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a9057a6[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:23,991 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-25 22:02:23,991 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,001 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:24,001 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,001 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:24,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:24,002 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:24,002 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,003 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:24,002 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:24,002 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:24,003 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. started... 2023-09-25 22:02:24,003 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. started... 2023-09-25 22:02:24,003 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d7f20f8ae5dd109b8e10bf12ec766ab5 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-25 22:02:24,003 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73efb43b3f4ff6185c88c3a016b28028 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-25 22:02:24,009 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:24,009 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:24,009 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:24,036 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d 2023-09-25 22:02:24,037 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279 2023-09-25 22:02:24,043 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/.tmp/cf/0afc02dc446d4f4d8bf31a137affa046 2023-09-25 22:02:24,044 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/.tmp/cf/9cd23935130145a48c72ab378c9f6ac7 2023-09-25 22:02:24,048 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:24,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-25 22:02:24,049 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/.tmp/cf/0afc02dc446d4f4d8bf31a137affa046 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046 2023-09-25 22:02:24,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:24,049 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/.tmp/cf/9cd23935130145a48c72ab378c9f6ac7 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7 2023-09-25 22:02:24,050 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:24,054 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046, entries=6, sequenceid=6, filesize=5.9 K 2023-09-25 22:02:24,054 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7, entries=44, sequenceid=6, filesize=12.2 K 2023-09-25 22:02:24,055 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 73efb43b3f4ff6185c88c3a016b28028 in 52ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:24,055 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for d7f20f8ae5dd109b8e10bf12ec766ab5 in 52ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:24,056 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-25 22:02:24,056 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-25 22:02:24,057 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73efb43b3f4ff6185c88c3a016b28028: 2023-09-25 22:02:24,057 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d7f20f8ae5dd109b8e10bf12ec766ab5: 2023-09-25 22:02:24,057 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046] hfiles 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046 for snapshot=snaptb0-testConsecutiveExports 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7] hfiles 2023-09-25 22:02:24,058 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7 for snapshot=snaptb0-testConsecutiveExports 2023-09-25 22:02:24,071 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. completed. 2023-09-25 22:02:24,071 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:24,071 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:24,071 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:24,071 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,071 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:24,071 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:24,073 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. completed. 2023-09-25 22:02:24,073 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:24,073 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:24,073 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:24,073 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,073 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-25 22:02:24,073 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:24,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,076 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:24,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:24,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:24,076 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:24,076 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:24,084 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-25 22:02:24,084 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:24,084 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:24,084 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-25 22:02:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:02:24,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-25 22:02:24,092 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-25 22:02:24,092 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:24,092 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:24,092 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-25 22:02:24,092 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:24,100 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,100 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:24,100 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,100 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:24,101 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,102 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,102 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,103 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:24,103 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-25 22:02:24,104 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-25 22:02:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:24,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:24,163 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:24,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-25 22:02:24,164 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:24,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:24,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,164 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:24,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:24,165 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:24,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,168 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,168 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:24,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:24,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d] mob files 2023-09-25 22:02:24,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279 2023-09-25 22:02:24,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d 2023-09-25 22:02:24,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-25 22:02:24,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-25 22:02:24,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,207 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695679343946Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695679344178 (+232 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695679344178Loading Region manifests for snaptb0-testConsecutiveExports at 1695679344178Writing data manifest for snaptb0-testConsecutiveExports at 1695679344183 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695679344196 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695679344206 (+10 ms) 2023-09-25 22:02:24,210 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-25 22:02:24,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 263 msec 2023-09-25 22:02:24,250 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:24,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-25 22:02:24,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:24,252 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252 2023-09-25 22:02:24,253 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:24,276 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:24,276 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7cbcfee2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,276 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-25 22:02:24,283 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:24,293 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:24,293 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:24,294 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:24,294 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,014 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-8973927875479083048.jar 2023-09-25 22:02:25,014 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,015 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,068 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-4483254886603139891.jar 2023-09-25 22:02:25,068 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,069 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,069 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,069 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,070 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,070 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:25,070 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:02:25,071 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:02:25,071 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:02:25,071 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:02:25,071 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:02:25,072 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:02:25,072 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:02:25,072 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:02:25,073 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:02:25,073 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:02:25,074 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:25,074 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:25,074 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:25,075 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:25,075 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:25,075 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:25,076 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:25,423 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:02:25,425 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-25 22:02:25,427 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-25 22:02:26,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:26,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:26,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0002_000001 (auth:SIMPLE) 2023-09-25 22:02:26,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0003_000001 (auth:SIMPLE) 2023-09-25 22:02:28,177 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:02:30,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0003_000001 (auth:SIMPLE) 2023-09-25 22:02:32,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0003_000001 (auth:SIMPLE) 2023-09-25 22:02:35,356 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0003_000001 (auth:SIMPLE) 2023-09-25 22:02:35,366 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695679308029_0003_01_000002 is : 143 2023-09-25 22:02:36,615 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:02:36,616 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:02:36,620 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-25 22:02:36,620 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:02:36,621 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:02:36,621 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-25 22:02:36,623 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-25 22:02:36,623 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-25 22:02:36,623 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@93ccd5e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-25 22:02:36,624 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-25 22:02:36,624 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-25 22:02:36,625 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:36,644 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:36,644 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@322d6986, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:36,644 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-25 22:02:36,655 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-25 22:02:36,666 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:36,666 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:36,667 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:36,667 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,371 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-5952925739461176117.jar 2023-09-25 22:02:37,371 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,372 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,424 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-6565927263119077970.jar 2023-09-25 22:02:37,425 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,425 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,426 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,426 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,426 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,426 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:37,427 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:02:37,427 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:02:37,427 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:02:37,428 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:02:37,428 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:02:37,428 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:02:37,429 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:02:37,429 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:02:37,429 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:02:37,430 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:02:37,430 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:37,430 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:37,431 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:37,431 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:37,431 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:37,432 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:37,432 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:37,772 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:02:37,774 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-25 22:02:37,777 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-25 22:02:41,569 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:41,569 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:41,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0003_000001 (auth:SIMPLE) 2023-09-25 22:02:42,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0004_000001 (auth:SIMPLE) 2023-09-25 22:02:45,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0004_000001 (auth:SIMPLE) 2023-09-25 22:02:48,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0004_000001 (auth:SIMPLE) 2023-09-25 22:02:50,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0004_000001 (auth:SIMPLE) 2023-09-25 22:02:52,023 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:02:52,023 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:02:52,026 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-25 22:02:52,026 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:02:52,026 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:02:52,026 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-25 22:02:52,028 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-25 22:02:52,028 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-25 22:02:52,028 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@93ccd5e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-25 22:02:52,029 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-25 22:02:52,029 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/local-export-1695679344252/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-25 22:02:52,040 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-25 22:02:52,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testConsecutiveExports 2023-09-25 22:02:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-25 22:02:52,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679372044"}]},"ts":"1695679372044"} 2023-09-25 22:02:52,045 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-25 22:02:52,082 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-25 22:02:52,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, UNASSIGN}] 2023-09-25 22:02:52,086 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, UNASSIGN 2023-09-25 22:02:52,086 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, UNASSIGN 2023-09-25 22:02:52,088 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d7f20f8ae5dd109b8e10bf12ec766ab5, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:52,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=73efb43b3f4ff6185c88c3a016b28028, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:52,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679372087"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679372087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679372087"}]},"ts":"1695679372087"} 2023-09-25 22:02:52,088 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679372088"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679372088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679372088"}]},"ts":"1695679372088"} 2023-09-25 22:02:52,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure d7f20f8ae5dd109b8e10bf12ec766ab5, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:52,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 73efb43b3f4ff6185c88c3a016b28028, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:02:52,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-25 22:02:52,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:52,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing d7f20f8ae5dd109b8e10bf12ec766ab5, disabling compactions & flushes 2023-09-25 22:02:52,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:52,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:52,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:52,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 73efb43b3f4ff6185c88c3a016b28028, disabling compactions & flushes 2023-09-25 22:02:52,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:52,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:52,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. after waiting 0 ms 2023-09-25 22:02:52,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:52,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. after waiting 0 ms 2023-09-25 22:02:52,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:52,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:52,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:02:52,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:52,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:52,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028. 2023-09-25 22:02:52,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 73efb43b3f4ff6185c88c3a016b28028: 2023-09-25 22:02:52,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5. 2023-09-25 22:02:52,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for d7f20f8ae5dd109b8e10bf12ec766ab5: 2023-09-25 22:02:52,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:52,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d7f20f8ae5dd109b8e10bf12ec766ab5, regionState=CLOSED 2023-09-25 22:02:52,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:52,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679372270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679372270"}]},"ts":"1695679372270"} 2023-09-25 22:02:52,270 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=73efb43b3f4ff6185c88c3a016b28028, regionState=CLOSED 2023-09-25 22:02:52,271 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695679372270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679372270"}]},"ts":"1695679372270"} 2023-09-25 22:02:52,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-25 22:02:52,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure d7f20f8ae5dd109b8e10bf12ec766ab5, server=jenkins-hbase16.apache.org,40943,1695679301586 in 183 msec 2023-09-25 22:02:52,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-25 22:02:52,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 73efb43b3f4ff6185c88c3a016b28028, server=jenkins-hbase16.apache.org,37003,1695679301677 in 183 msec 2023-09-25 22:02:52,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d7f20f8ae5dd109b8e10bf12ec766ab5, UNASSIGN in 192 msec 2023-09-25 22:02:52,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-25 22:02:52,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73efb43b3f4ff6185c88c3a016b28028, UNASSIGN in 193 msec 2023-09-25 22:02:52,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679372279"}]},"ts":"1695679372279"} 2023-09-25 22:02:52,280 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-25 22:02:52,291 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-25 22:02:52,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 252 msec 2023-09-25 22:02:52,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-25 22:02:52,347 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-25 22:02:52,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testConsecutiveExports 2023-09-25 22:02:52,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,351 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-25 22:02:52,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,357 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-25 22:02:52,362 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:52,362 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:52,366 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/recovered.edits] 2023-09-25 22:02:52,366 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/recovered.edits] 2023-09-25 22:02:52,370 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/cf/0afc02dc446d4f4d8bf31a137affa046 2023-09-25 22:02:52,370 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/cf/9cd23935130145a48c72ab378c9f6ac7 2023-09-25 22:02:52,372 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028/recovered.edits/9.seqid 2023-09-25 22:02:52,373 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5/recovered.edits/9.seqid 2023-09-25 22:02:52,374 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/73efb43b3f4ff6185c88c3a016b28028 2023-09-25 22:02:52,374 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,374 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,374 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testConsecutiveExports/d7f20f8ae5dd109b8e10bf12ec766ab5 2023-09-25 22:02:52,374 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-25 22:02:52,374 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-25 22:02:52,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-25 22:02:52,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-25 22:02:52,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-25 22:02:52,375 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-25 22:02:52,376 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-25 22:02:52,378 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230925c3e8ea9b620a4adca791eb7110044279 2023-09-25 22:02:52,379 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230925c337027784a94729a863d79d088cd71d 2023-09-25 22:02:52,379 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-25 22:02:52,381 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,383 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,383 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-25 22:02:52,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-25 22:02:52,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-25 22:02:52,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-25 22:02:52,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679372386"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:52,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679372386"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:52,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:02:52,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 73efb43b3f4ff6185c88c3a016b28028, NAME => 'testtb-testConsecutiveExports,,1695679342860.73efb43b3f4ff6185c88c3a016b28028.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d7f20f8ae5dd109b8e10bf12ec766ab5, NAME => 'testtb-testConsecutiveExports,1,1695679342860.d7f20f8ae5dd109b8e10bf12ec766ab5.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:02:52,388 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-25 22:02:52,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679372388"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:52,390 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-25 22:02:52,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-25 22:02:52,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 52 msec 2023-09-25 22:02:52,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-25 22:02:52,486 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-25 22:02:52,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-25 22:02:52,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-25 22:02:52,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testConsecutiveExports" 2023-09-25 22:02:52,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-25 22:02:52,538 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 762), OpenFileDescriptor=906 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 182) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4026 (was 4228) 2023-09-25 22:02:52,538 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-25 22:02:52,557 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=4025 2023-09-25 22:02:52,557 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-25 22:02:52,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:02:52,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:52,563 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:02:52,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-25 22:02:52,564 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:02:52,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-25 22:02:52,567 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,568 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,568 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d empty. 2023-09-25 22:02:52,568 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 empty. 2023-09-25 22:02:52,569 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,569 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,569 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-25 22:02:52,586 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-25 22:02:52,587 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 419c904f9465a7e1943cd50a1f549f7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:52,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => ab63147b79a49729566e03a372376471, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:52,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:52,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:52,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing ab63147b79a49729566e03a372376471, disabling compactions & flushes 2023-09-25 22:02:52,606 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 419c904f9465a7e1943cd50a1f549f7d, disabling compactions & flushes 2023-09-25 22:02:52,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. after waiting 0 ms 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. after waiting 0 ms 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for ab63147b79a49729566e03a372376471: 2023-09-25 22:02:52,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 419c904f9465a7e1943cd50a1f549f7d: 2023-09-25 22:02:52,609 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:02:52,610 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679372610"}]},"ts":"1695679372610"} 2023-09-25 22:02:52,610 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679372610"}]},"ts":"1695679372610"} 2023-09-25 22:02:52,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:02:52,617 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:02:52,617 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679372617"}]},"ts":"1695679372617"} 2023-09-25 22:02:52,618 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-25 22:02:52,633 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:02:52,634 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:02:52,634 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:02:52,634 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:02:52,634 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:02:52,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, ASSIGN}] 2023-09-25 22:02:52,636 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, ASSIGN 2023-09-25 22:02:52,636 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, ASSIGN 2023-09-25 22:02:52,637 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:02:52,637 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,37003,1695679301677; forceNewPlan=false, retain=false 2023-09-25 22:02:52,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-25 22:02:52,787 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:02:52,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ab63147b79a49729566e03a372376471, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:52,790 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=419c904f9465a7e1943cd50a1f549f7d, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:52,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372790"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679372790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679372790"}]},"ts":"1695679372790"} 2023-09-25 22:02:52,791 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372790"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679372790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679372790"}]},"ts":"1695679372790"} 2023-09-25 22:02:52,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure ab63147b79a49729566e03a372376471, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:02:52,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 419c904f9465a7e1943cd50a1f549f7d, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:52,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-25 22:02:52,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 419c904f9465a7e1943cd50a1f549f7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab63147b79a49729566e03a372376471, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. service=AccessControlService 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. service=AccessControlService 2023-09-25 22:02:52,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:52,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,960 INFO [StoreOpener-419c904f9465a7e1943cd50a1f549f7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,960 INFO [StoreOpener-ab63147b79a49729566e03a372376471-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,961 DEBUG [StoreOpener-419c904f9465a7e1943cd50a1f549f7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf 2023-09-25 22:02:52,961 DEBUG [StoreOpener-419c904f9465a7e1943cd50a1f549f7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf 2023-09-25 22:02:52,961 DEBUG [StoreOpener-ab63147b79a49729566e03a372376471-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf 2023-09-25 22:02:52,961 DEBUG [StoreOpener-ab63147b79a49729566e03a372376471-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf 2023-09-25 22:02:52,961 INFO [StoreOpener-ab63147b79a49729566e03a372376471-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab63147b79a49729566e03a372376471 columnFamilyName cf 2023-09-25 22:02:52,961 INFO [StoreOpener-419c904f9465a7e1943cd50a1f549f7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 419c904f9465a7e1943cd50a1f549f7d columnFamilyName cf 2023-09-25 22:02:52,962 INFO [StoreOpener-ab63147b79a49729566e03a372376471-1] regionserver.HStore(310): Store=ab63147b79a49729566e03a372376471/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:52,962 INFO [StoreOpener-419c904f9465a7e1943cd50a1f549f7d-1] regionserver.HStore(310): Store=419c904f9465a7e1943cd50a1f549f7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:02:52,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ab63147b79a49729566e03a372376471 2023-09-25 22:02:52,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:52,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:52,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ab63147b79a49729566e03a372376471; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62455685, jitterRate=-0.06933777034282684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:52,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 419c904f9465a7e1943cd50a1f549f7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61704029, jitterRate=-0.0805383175611496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:52,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ab63147b79a49729566e03a372376471: 2023-09-25 22:02:52,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 419c904f9465a7e1943cd50a1f549f7d: 2023-09-25 22:02:52,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471., pid=60, masterSystemTime=1695679372945 2023-09-25 22:02:52,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d., pid=61, masterSystemTime=1695679372945 2023-09-25 22:02:52,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:52,972 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ab63147b79a49729566e03a372376471, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:52,972 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372972"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679372972"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679372972"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679372972"}]},"ts":"1695679372972"} 2023-09-25 22:02:52,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:52,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=419c904f9465a7e1943cd50a1f549f7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:52,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679372973"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679372973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679372973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679372973"}]},"ts":"1695679372973"} 2023-09-25 22:02:52,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-25 22:02:52,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure ab63147b79a49729566e03a372376471, server=jenkins-hbase16.apache.org,37003,1695679301677 in 182 msec 2023-09-25 22:02:52,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-25 22:02:52,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 419c904f9465a7e1943cd50a1f549f7d, server=jenkins-hbase16.apache.org,40943,1695679301586 in 182 msec 2023-09-25 22:02:52,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, ASSIGN in 342 msec 2023-09-25 22:02:52,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-25 22:02:52,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, ASSIGN in 343 msec 2023-09-25 22:02:52,978 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:02:52,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679372978"}]},"ts":"1695679372978"} 2023-09-25 22:02:52,980 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-25 22:02:52,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:02:52,991 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-25 22:02:52,993 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-25 22:02:52,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:52,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:53,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:53,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:53,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:53,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:53,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 449 msec 2023-09-25 22:02:53,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-25 22:02:53,171 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-25 22:02:53,177 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,177 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,179 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:53,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679373193 (current time:1695679373193). 2023-09-25 22:02:53,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:53,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x55e66d7c to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:53,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@578a6013, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:53,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,213 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55e66d7c to 127.0.0.1:60419 2023-09-25 22:02:53,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:53,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x715f2d1b to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:53,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17b433c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:53,236 DEBUG [hconnection-0x133a53dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,236 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,242 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x715f2d1b to 127.0.0.1:60419 2023-09-25 22:02:53,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:53,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-25 22:02:53,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:53,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,248 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,248 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695679973248 2023-09-25 22:02:53,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,250 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:53,250 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:53,251 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-25 22:02:53,254 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,254 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695679973254 2023-09-25 22:02:53,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,264 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-25 22:02:53,264 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,265 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-25 22:02:53,265 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-25 22:02:53,266 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,266 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,274 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,274 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,274 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,274 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,275 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,275 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,277 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,277 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,277 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,277 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,277 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,277 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,277 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,278 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,278 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,278 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,277 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,278 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,280 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,281 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,281 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,281 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,281 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,281 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,291 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,291 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,299 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,299 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,308 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,309 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5aed45[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-25 22:02:53,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5aed45[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:53,318 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-25 22:02:53,318 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,325 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,325 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,325 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,328 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,327 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,328 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:53,328 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,329 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,328 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:53,329 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,329 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:53,330 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,329 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,330 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. started... 2023-09-25 22:02:53,329 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:53,330 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:53,329 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. started... 2023-09-25 22:02:53,330 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 419c904f9465a7e1943cd50a1f549f7d: 2023-09-25 22:02:53,330 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,333 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab63147b79a49729566e03a372376471: 2023-09-25 22:02:53,333 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:53,333 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,334 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,334 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:53,334 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:53,334 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:53,334 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:02:53,350 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. completed. 2023-09-25 22:02:53,350 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:53,350 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:53,350 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. completed. 2023-09-25 22:02:53,351 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,351 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:53,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-25 22:02:53,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:53,352 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:53,365 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,365 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,365 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,374 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,374 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,375 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,375 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,375 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,377 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,377 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,375 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:53,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-25 22:02:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:02:53,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-25 22:02:53,392 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-25 22:02:53,392 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:53,392 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:53,392 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,392 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,399 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,400 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,400 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,400 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,402 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,402 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,402 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,408 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,408 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,410 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:02:53,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-25 22:02:53,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,438 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695679373249Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695679373421 (+172 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695679373421Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695679373421Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695679373424 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695679373432 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695679373438 (+6 ms) 2023-09-25 22:02:53,440 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 191 msec 2023-09-25 22:02:53,552 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:53,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-25 22:02:53,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:53,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:53,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37003] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:02:53,569 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,569 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,570 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:02:53,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679373580 (current time:1695679373580). 2023-09-25 22:02:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:53,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x6e79ce3d to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:53,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75a97de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,596 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e79ce3d to 127.0.0.1:60419 2023-09-25 22:02:53,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:53,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x51065cab to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:53,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ae7890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:53,619 DEBUG [hconnection-0x2219e51c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,623 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:53,631 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:53,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51065cab to 127.0.0.1:60419 2023-09-25 22:02:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-25 22:02:53,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:53,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,638 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,639 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695679973639 2023-09-25 22:02:53,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-25 22:02:53,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,641 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:53,641 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:53,643 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-25 22:02:53,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-25 22:02:53,647 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,647 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695679973647 2023-09-25 22:02:53,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,658 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-25 22:02:53,659 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,660 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-25 22:02:53,660 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-25 22:02:53,661 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,661 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,666 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,666 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,666 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,666 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,667 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,667 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,668 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,668 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,669 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,669 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,669 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,671 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,672 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,672 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,669 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,672 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-25 22:02:53,674 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:53,674 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,675 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,675 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,675 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-25 22:02:53,675 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-25 22:02:53,675 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-25 22:02:53,683 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,683 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,691 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,691 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,699 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,700 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-25 22:02:53,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623eef57[Count = 1] remaining members to acquire global barrier 2023-09-25 22:02:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-25 22:02:53,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623eef57[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:53,715 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-25 22:02:53,715 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,726 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,726 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:53,726 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,726 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,727 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:53,727 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,727 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,727 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:53,727 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-25 22:02:53,727 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. started... 2023-09-25 22:02:53,727 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:53,728 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:53,728 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:53,728 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 419c904f9465a7e1943cd50a1f549f7d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-25 22:02:53,728 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:53,728 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. started... 2023-09-25 22:02:53,729 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ab63147b79a49729566e03a372376471 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-25 22:02:53,733 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,733 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,733 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,742 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:53,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-25 22:02:53,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:53,743 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:53,752 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a 2023-09-25 22:02:53,752 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e 2023-09-25 22:02:53,761 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/.tmp/cf/9453375a6eaa481a95d945dc79efe4a9 2023-09-25 22:02:53,762 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/.tmp/cf/948704085ac841cca0b137e18ab5a759 2023-09-25 22:02:53,766 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/.tmp/cf/9453375a6eaa481a95d945dc79efe4a9 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9 2023-09-25 22:02:53,766 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/.tmp/cf/948704085ac841cca0b137e18ab5a759 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759 2023-09-25 22:02:53,770 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9, entries=6, sequenceid=6, filesize=6.0 K 2023-09-25 22:02:53,770 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759, entries=44, sequenceid=6, filesize=13.0 K 2023-09-25 22:02:53,772 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for ab63147b79a49729566e03a372376471 in 43ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:53,772 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-25 22:02:53,772 INFO [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 419c904f9465a7e1943cd50a1f549f7d in 44ms, sequenceid=6, compaction requested=false 2023-09-25 22:02:53,773 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ab63147b79a49729566e03a372376471: 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 419c904f9465a7e1943cd50a1f549f7d: 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9] hfiles 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759] hfiles 2023-09-25 22:02:53,775 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,788 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. completed. 2023-09-25 22:02:53,788 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. completed. 2023-09-25 22:02:53,788 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:02:53,788 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:02:53,788 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:53,788 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:53,788 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,788 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-25 22:02:53,789 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:53,825 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,825 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,825 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-25 22:02:53,825 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,825 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,825 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,825 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,827 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-25 22:02:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:53,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-25 22:02:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:02:53,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-25 22:02:53,845 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-25 22:02:53,845 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:53,845 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:53,846 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,846 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,858 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,860 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:53,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,862 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:53,863 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:53,868 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,868 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,869 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,874 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,874 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,874 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,874 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,875 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:53,875 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:53,877 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:02:53,878 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,878 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:53,878 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:53,878 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:53,878 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a] mob files 2023-09-25 22:02:53,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e 2023-09-25 22:02:53,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a 2023-09-25 22:02:53,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-25 22:02:53,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,906 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:02:53,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695679373640Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695679373888 (+248 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695679373888Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695679373888Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695679373892 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695679373898 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695679373905 (+7 ms) 2023-09-25 22:02:53,909 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-25 22:02:53,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 268 msec 2023-09-25 22:02:53,944 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:53,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-25 22:02:53,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:53,973 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:02:53,976 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:02:53,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33807] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-25 22:02:53,978 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:02:53,983 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:56846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:02:53,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37003] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-25 22:02:53,984 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-25 22:02:53,986 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-25 22:02:53,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-25 22:02:53,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-25 22:02:53,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:53,991 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:02:53,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-25 22:02:53,992 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:02:53,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-25 22:02:53,995 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:53,995 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:53,995 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 empty. 2023-09-25 22:02:53,995 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 empty. 2023-09-25 22:02:53,996 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:53,996 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:53,996 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-25 22:02:54,005 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-25 22:02:54,006 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71d8d6b63c95e6f3ec85e26e0aa4a6c4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:54,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c82cd3919039dbdb633b39c0de257764, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:02:54,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:54,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 71d8d6b63c95e6f3ec85e26e0aa4a6c4, disabling compactions & flushes 2023-09-25 22:02:54,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. after waiting 0 ms 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 71d8d6b63c95e6f3ec85e26e0aa4a6c4: 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:54,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c82cd3919039dbdb633b39c0de257764, disabling compactions & flushes 2023-09-25 22:02:54,024 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. after waiting 0 ms 2023-09-25 22:02:54,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,024 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c82cd3919039dbdb633b39c0de257764: 2023-09-25 22:02:54,026 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:02:54,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679374027"}]},"ts":"1695679374027"} 2023-09-25 22:02:54,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679374027"}]},"ts":"1695679374027"} 2023-09-25 22:02:54,030 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:02:54,030 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:02:54,031 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679374031"}]},"ts":"1695679374031"} 2023-09-25 22:02:54,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-25 22:02:54,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:02:54,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:02:54,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:02:54,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:02:54,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:02:54,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, ASSIGN}] 2023-09-25 22:02:54,053 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, ASSIGN 2023-09-25 22:02:54,054 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, ASSIGN 2023-09-25 22:02:54,054 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:02:54,054 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:02:54,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-25 22:02:54,204 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:02:54,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=71d8d6b63c95e6f3ec85e26e0aa4a6c4, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:54,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c82cd3919039dbdb633b39c0de257764, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:54,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374209"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679374209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679374209"}]},"ts":"1695679374209"} 2023-09-25 22:02:54,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679374210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679374210"}]},"ts":"1695679374210"} 2023-09-25 22:02:54,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 71d8d6b63c95e6f3ec85e26e0aa4a6c4, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:54,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure c82cd3919039dbdb633b39c0de257764, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:02:54,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-25 22:02:54,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71d8d6b63c95e6f3ec85e26e0aa4a6c4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.', STARTKEY => '', ENDKEY => '2'} 2023-09-25 22:02:54,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. service=AccessControlService 2023-09-25 22:02:54,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:54,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c82cd3919039dbdb633b39c0de257764, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.', STARTKEY => '2', ENDKEY => ''} 2023-09-25 22:02:54,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. service=AccessControlService 2023-09-25 22:02:54,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,378 INFO [StoreOpener-71d8d6b63c95e6f3ec85e26e0aa4a6c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,379 INFO [StoreOpener-c82cd3919039dbdb633b39c0de257764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,380 DEBUG [StoreOpener-71d8d6b63c95e6f3ec85e26e0aa4a6c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf 2023-09-25 22:02:54,380 DEBUG [StoreOpener-71d8d6b63c95e6f3ec85e26e0aa4a6c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf 2023-09-25 22:02:54,380 DEBUG [StoreOpener-c82cd3919039dbdb633b39c0de257764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf 2023-09-25 22:02:54,380 DEBUG [StoreOpener-c82cd3919039dbdb633b39c0de257764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf 2023-09-25 22:02:54,381 INFO [StoreOpener-71d8d6b63c95e6f3ec85e26e0aa4a6c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71d8d6b63c95e6f3ec85e26e0aa4a6c4 columnFamilyName cf 2023-09-25 22:02:54,381 INFO [StoreOpener-c82cd3919039dbdb633b39c0de257764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c82cd3919039dbdb633b39c0de257764 columnFamilyName cf 2023-09-25 22:02:54,381 INFO [StoreOpener-c82cd3919039dbdb633b39c0de257764-1] regionserver.HStore(310): Store=c82cd3919039dbdb633b39c0de257764/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:54,381 INFO [StoreOpener-71d8d6b63c95e6f3ec85e26e0aa4a6c4-1] regionserver.HStore(310): Store=71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:54,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:54,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 71d8d6b63c95e6f3ec85e26e0aa4a6c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69110052, jitterRate=0.029820024967193604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 71d8d6b63c95e6f3ec85e26e0aa4a6c4: 2023-09-25 22:02:54,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4., pid=69, masterSystemTime=1695679374365 2023-09-25 22:02:54,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=71d8d6b63c95e6f3ec85e26e0aa4a6c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:54,391 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374391"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679374391"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679374391"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679374391"}]},"ts":"1695679374391"} 2023-09-25 22:02:54,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:02:54,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-25 22:02:54,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened c82cd3919039dbdb633b39c0de257764; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74767689, jitterRate=0.11412538588047028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:54,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 71d8d6b63c95e6f3ec85e26e0aa4a6c4, server=jenkins-hbase16.apache.org,40943,1695679301586 in 180 msec 2023-09-25 22:02:54,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for c82cd3919039dbdb633b39c0de257764: 2023-09-25 22:02:54,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764., pid=70, masterSystemTime=1695679374366 2023-09-25 22:02:54,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, ASSIGN in 343 msec 2023-09-25 22:02:54,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,396 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c82cd3919039dbdb633b39c0de257764, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:54,397 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374396"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679374396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679374396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679374396"}]},"ts":"1695679374396"} 2023-09-25 22:02:54,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-25 22:02:54,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure c82cd3919039dbdb633b39c0de257764, server=jenkins-hbase16.apache.org,33807,1695679301636 in 184 msec 2023-09-25 22:02:54,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-25 22:02:54,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, ASSIGN in 348 msec 2023-09-25 22:02:54,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:02:54,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679374401"}]},"ts":"1695679374401"} 2023-09-25 22:02:54,402 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-25 22:02:54,408 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:02:54,409 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-25 22:02:54,410 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-25 22:02:54,416 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:54,416 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:54,416 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:54,416 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,425 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-25 22:02:54,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 435 msec 2023-09-25 22:02:54,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-25 22:02:54,599 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-25 22:02:54,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$2(1952): Client=jenkins//188.40.62.62 merge regions 71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764], force=true 2023-09-25 22:02:54,635 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764], force=true 2023-09-25 22:02:54,635 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764], force=true 2023-09-25 22:02:54,635 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764], force=true 2023-09-25 22:02:54,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-25 22:02:54,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, UNASSIGN}] 2023-09-25 22:02:54,659 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, UNASSIGN 2023-09-25 22:02:54,659 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, UNASSIGN 2023-09-25 22:02:54,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c82cd3919039dbdb633b39c0de257764, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:54,659 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=71d8d6b63c95e6f3ec85e26e0aa4a6c4, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:54,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374659"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679374659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679374659"}]},"ts":"1695679374659"} 2023-09-25 22:02:54,660 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374659"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679374659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679374659"}]},"ts":"1695679374659"} 2023-09-25 22:02:54,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure c82cd3919039dbdb633b39c0de257764, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:02:54,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 71d8d6b63c95e6f3ec85e26e0aa4a6c4, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:54,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-25 22:02:54,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing c82cd3919039dbdb633b39c0de257764, disabling compactions & flushes 2023-09-25 22:02:54,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. after waiting 0 ms 2023-09-25 22:02:54,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 71d8d6b63c95e6f3ec85e26e0aa4a6c4, disabling compactions & flushes 2023-09-25 22:02:54,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing c82cd3919039dbdb633b39c0de257764 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-25 22:02:54,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. after waiting 0 ms 2023-09-25 22:02:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 71d8d6b63c95e6f3ec85e26e0aa4a6c4 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-25 22:02:54,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/.tmp/cf/103c260b49dd4e3dac66d2f577207a6f 2023-09-25 22:02:54,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/.tmp/cf/d98687e7fd314f44aecdde9a608d725e 2023-09-25 22:02:54,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/.tmp/cf/d98687e7fd314f44aecdde9a608d725e as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e 2023-09-25 22:02:54,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/.tmp/cf/103c260b49dd4e3dac66d2f577207a6f as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f 2023-09-25 22:02:54,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e, entries=1, sequenceid=5, filesize=4.7 K 2023-09-25 22:02:54,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f, entries=1, sequenceid=5, filesize=4.7 K 2023-09-25 22:02:54,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 71d8d6b63c95e6f3ec85e26e0aa4a6c4 in 32ms, sequenceid=5, compaction requested=false 2023-09-25 22:02:54,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-25 22:02:54,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c82cd3919039dbdb633b39c0de257764 in 38ms, sequenceid=5, compaction requested=false 2023-09-25 22:02:54,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-25 22:02:54,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-25 22:02:54,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:54,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:02:54,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764. 2023-09-25 22:02:54,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4. 2023-09-25 22:02:54,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 71d8d6b63c95e6f3ec85e26e0aa4a6c4: 2023-09-25 22:02:54,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for c82cd3919039dbdb633b39c0de257764: 2023-09-25 22:02:54,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed c82cd3919039dbdb633b39c0de257764 2023-09-25 22:02:54,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c82cd3919039dbdb633b39c0de257764, regionState=CLOSED 2023-09-25 22:02:54,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:02:54,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679374870"}]},"ts":"1695679374870"} 2023-09-25 22:02:54,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=71d8d6b63c95e6f3ec85e26e0aa4a6c4, regionState=CLOSED 2023-09-25 22:02:54,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695679374870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679374870"}]},"ts":"1695679374870"} 2023-09-25 22:02:54,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-25 22:02:54,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure c82cd3919039dbdb633b39c0de257764, server=jenkins-hbase16.apache.org,33807,1695679301636 in 210 msec 2023-09-25 22:02:54,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-25 22:02:54,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 71d8d6b63c95e6f3ec85e26e0aa4a6c4, server=jenkins-hbase16.apache.org,40943,1695679301586 in 210 msec 2023-09-25 22:02:54,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c82cd3919039dbdb633b39c0de257764, UNASSIGN in 217 msec 2023-09-25 22:02:54,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-25 22:02:54,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71d8d6b63c95e6f3ec85e26e0aa4a6c4, UNASSIGN in 222 msec 2023-09-25 22:02:54,916 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-25 22:02:54,918 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373988.71d8d6b63c95e6f3ec85e26e0aa4a6c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:54,918 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695679373988.c82cd3919039dbdb633b39c0de257764.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:54,918 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-25 22:02:54,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-25 22:02:54,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, ASSIGN}] 2023-09-25 22:02:54,962 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, ASSIGN 2023-09-25 22:02:54,963 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, ASSIGN; state=MERGED, location=jenkins-hbase16.apache.org,40943,1695679301586; forceNewPlan=false, retain=false 2023-09-25 22:02:55,113 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-25 22:02:55,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0b6611ff373502c11c8277c0f32a0c60, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695679375117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679375117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679375117"}]},"ts":"1695679375117"} 2023-09-25 22:02:55,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0b6611ff373502c11c8277c0f32a0c60, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:02:55,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-25 22:02:55,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:02:55,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b6611ff373502c11c8277c0f32a0c60, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.', STARTKEY => '', ENDKEY => ''} 2023-09-25 22:02:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. service=AccessControlService 2023-09-25 22:02:55,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:02:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:02:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/.regioninfo 2023-09-25 22:02:55,294 INFO [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,295 DEBUG [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf 2023-09-25 22:02:55,295 DEBUG [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf 2023-09-25 22:02:55,295 INFO [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b6611ff373502c11c8277c0f32a0c60 columnFamilyName cf 2023-09-25 22:02:55,323 DEBUG [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] regionserver.HStore(539): loaded hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/103c260b49dd4e3dac66d2f577207a6f.71d8d6b63c95e6f3ec85e26e0aa4a6c4->hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f-top 2023-09-25 22:02:55,328 DEBUG [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] regionserver.HStore(539): loaded hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/d98687e7fd314f44aecdde9a608d725e.c82cd3919039dbdb633b39c0de257764->hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e-top 2023-09-25 22:02:55,329 INFO [StoreOpener-0b6611ff373502c11c8277c0f32a0c60-1] regionserver.HStore(310): Store=0b6611ff373502c11c8277c0f32a0c60/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:02:55,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:02:55,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 0b6611ff373502c11c8277c0f32a0c60; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59525579, jitterRate=-0.11299975216388702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:02:55,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 0b6611ff373502c11c8277c0f32a0c60: 2023-09-25 22:02:55,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60., pid=77, masterSystemTime=1695679375274 2023-09-25 22:02:55,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.,because compaction is disabled. 2023-09-25 22:02:55,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:02:55,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:02:55,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0b6611ff373502c11c8277c0f32a0c60, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695679375337"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679375337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679375337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679375337"}]},"ts":"1695679375337"} 2023-09-25 22:02:55,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-25 22:02:55,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0b6611ff373502c11c8277c0f32a0c60, server=jenkins-hbase16.apache.org,40943,1695679301586 in 218 msec 2023-09-25 22:02:55,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-25 22:02:55,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, ASSIGN in 380 msec 2023-09-25 22:02:55,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[71d8d6b63c95e6f3ec85e26e0aa4a6c4, c82cd3919039dbdb633b39c0de257764], force=true in 714 msec 2023-09-25 22:02:55,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-25 22:02:55,748 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-25 22:02:55,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-25 22:02:55,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679375750 (current time:1695679375750). 2023-09-25 22:02:55,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:02:55,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x308ca371 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:55,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d22960c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:55,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:55,798 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:55,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x308ca371 to 127.0.0.1:60419 2023-09-25 22:02:55,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:55,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x6636dbed to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:02:55,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33f47b71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:02:55,820 DEBUG [hconnection-0x5a8f09f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:55,824 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:55,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:02:55,835 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:02:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6636dbed to 127.0.0.1:60419 2023-09-25 22:02:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:02:55,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-25 22:02:55,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:02:55,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-25 22:02:55,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-25 22:02:55,842 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-25 22:02:55,843 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695679975843 2023-09-25 22:02:55,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-25 22:02:55,847 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:02:55,847 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:02:55,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-25 22:02:55,848 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-25 22:02:55,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-25 22:02:55,851 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-25 22:02:55,852 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695679975852 2023-09-25 22:02:55,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,861 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-25 22:02:55,861 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:55,862 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-25 22:02:55,862 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-25 22:02:55,863 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,863 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,866 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:55,866 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,866 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:55,867 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,867 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-25 22:02:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-25 22:02:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,868 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-25 22:02:55,868 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-25 22:02:55,868 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-25 22:02:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,870 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-25 22:02:55,870 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-25 22:02:55,870 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:55,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-25 22:02:55,870 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-25 22:02:55,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:02:55,871 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-25 22:02:55,874 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-25 22:02:55,874 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-25 22:02:55,874 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-25 22:02:55,874 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,883 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,883 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:55,883 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,883 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:55,891 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,891 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,891 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:55,891 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,891 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:02:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:55,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-25 22:02:55,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d40bc33[Count = 0] remaining members to acquire global barrier 2023-09-25 22:02:55,893 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-25 22:02:55,893 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,900 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,900 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-25 22:02:55,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:02:55,900 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:02:55,900 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:02:55,901 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. started... 2023-09-25 22:02:55,902 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b6611ff373502c11c8277c0f32a0c60: 2023-09-25 22:02:55,902 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,903 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:02:55,903 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/103c260b49dd4e3dac66d2f577207a6f.71d8d6b63c95e6f3ec85e26e0aa4a6c4->hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f-top, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/d98687e7fd314f44aecdde9a608d725e.c82cd3919039dbdb633b39c0de257764->hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e-top] hfiles 2023-09-25 22:02:55,903 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/103c260b49dd4e3dac66d2f577207a6f.71d8d6b63c95e6f3ec85e26e0aa4a6c4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,903 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/d98687e7fd314f44aecdde9a608d725e.c82cd3919039dbdb633b39c0de257764 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,908 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-25 22:02:55,908 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:55,908 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-25 22:02:55,916 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-25 22:02:55,916 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:55,916 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-25 22:02:55,921 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. completed. 2023-09-25 22:02:55,921 DEBUG [rs(jenkins-hbase16.apache.org,40943,1695679301586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:02:55,922 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:02:55,922 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:02:55,922 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,922 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-25 22:02:55,922 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:02:55,947 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:55,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-25 22:02:55,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:02:55,950 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:02:55,955 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-25 22:02:55,955 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,956 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:55,956 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-25 22:02:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase16.apache.org,40943,1695679301586': 2023-09-25 22:02:55,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-25 22:02:55,968 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-25 22:02:55,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:02:55,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:02:55,968 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,968 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:55,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,983 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,984 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:55,984 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:02:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:02:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,985 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:02:55,986 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,989 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,990 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:02:55,990 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:56,000 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:02:56,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:56,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:56,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:55,999 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:55,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:56,000 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:56,000 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:02:56,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:56,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:56,000 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:02:56,000 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:02:56,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:02:56,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:02:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,001 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-25 22:02:56,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,018 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695679375843Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695679376000 (+157 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695679376000Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695679376003 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695679376009 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695679376018 (+9 ms) 2023-09-25 22:02:56,021 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-25 22:02:56,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 174 msec 2023-09-25 22:02:56,150 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:02:56,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-25 22:02:56,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:02:56,151 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151 2023-09-25 22:02:56,152 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44421, tgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151, rawTgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:56,173 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:02:56,173 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_721927536_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,173 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-25 22:02:56,181 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:02:56,210 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,210 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,211 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,211 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0004_000001 (auth:SIMPLE) 2023-09-25 22:02:56,920 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-1580193548543386108.jar 2023-09-25 22:02:56,920 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,921 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,974 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-7060463426630861131.jar 2023-09-25 22:02:56,975 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,975 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,975 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,976 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,976 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,976 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:02:56,977 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:02:56,977 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:02:56,977 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:02:56,978 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:02:56,978 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:02:56,978 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:02:56,978 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:02:56,979 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:02:56,979 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:02:56,980 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:02:56,980 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:56,980 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:56,981 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:56,981 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:56,981 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:02:56,981 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:56,982 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:02:57,417 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:02:57,419 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-25 22:02:57,421 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-25 22:02:57,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:57,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:02:57,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0005_000001 (auth:SIMPLE) 2023-09-25 22:02:57,853 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:03:00,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0005_000001 (auth:SIMPLE) 2023-09-25 22:03:03,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0005_000001 (auth:SIMPLE) 2023-09-25 22:03:06,124 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0005_000001 (auth:SIMPLE) 2023-09-25 22:03:07,811 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:03:07,813 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:03:07,821 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,821 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:03:07,821 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:03:07,821 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,822 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-25 22:03:07,822 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-25 22:03:07,822 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,823 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-25 22:03:07,823 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679376151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-25 22:03:07,831 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:07,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-25 22:03:07,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679387835"}]},"ts":"1695679387835"} 2023-09-25 22:03:07,837 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-25 22:03:07,873 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-25 22:03:07,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, UNASSIGN}] 2023-09-25 22:03:07,876 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, UNASSIGN 2023-09-25 22:03:07,877 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0b6611ff373502c11c8277c0f32a0c60, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:07,877 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695679387877"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679387877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679387877"}]},"ts":"1695679387877"} 2023-09-25 22:03:07,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0b6611ff373502c11c8277c0f32a0c60, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:03:07,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-25 22:03:08,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:03:08,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 0b6611ff373502c11c8277c0f32a0c60, disabling compactions & flushes 2023-09-25 22:03:08,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:03:08,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:03:08,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. after waiting 0 ms 2023-09-25 22:03:08,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:03:08,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-25 22:03:08,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:08,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60. 2023-09-25 22:03:08,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 0b6611ff373502c11c8277c0f32a0c60: 2023-09-25 22:03:08,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:03:08,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0b6611ff373502c11c8277c0f32a0c60, regionState=CLOSED 2023-09-25 22:03:08,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695679388057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679388057"}]},"ts":"1695679388057"} 2023-09-25 22:03:08,061 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-25 22:03:08,061 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0b6611ff373502c11c8277c0f32a0c60, server=jenkins-hbase16.apache.org,40943,1695679301586 in 179 msec 2023-09-25 22:03:08,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-25 22:03:08,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b6611ff373502c11c8277c0f32a0c60, UNASSIGN in 187 msec 2023-09-25 22:03:08,063 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679388063"}]},"ts":"1695679388063"} 2023-09-25 22:03:08,064 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-25 22:03:08,074 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-25 22:03:08,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 243 msec 2023-09-25 22:03:08,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-25 22:03:08,141 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-25 22:03:08,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,148 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,149 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,151 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,156 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:03:08,156 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:03:08,156 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:03:08,158 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/recovered.edits] 2023-09-25 22:03:08,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/recovered.edits] 2023-09-25 22:03:08,158 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/recovered.edits] 2023-09-25 22:03:08,162 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/103c260b49dd4e3dac66d2f577207a6f.71d8d6b63c95e6f3ec85e26e0aa4a6c4 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/103c260b49dd4e3dac66d2f577207a6f.71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:03:08,162 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/cf/103c260b49dd4e3dac66d2f577207a6f 2023-09-25 22:03:08,163 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/cf/d98687e7fd314f44aecdde9a608d725e 2023-09-25 22:03:08,164 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/d98687e7fd314f44aecdde9a608d725e.c82cd3919039dbdb633b39c0de257764 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/cf/d98687e7fd314f44aecdde9a608d725e.c82cd3919039dbdb633b39c0de257764 2023-09-25 22:03:08,165 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,165 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,166 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,165 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-25 22:03:08,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-25 22:03:08,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-25 22:03:08,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-25 22:03:08,166 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/recovered.edits/8.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764/recovered.edits/8.seqid 2023-09-25 22:03:08,167 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/recovered.edits/8.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4/recovered.edits/8.seqid 2023-09-25 22:03:08,167 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c82cd3919039dbdb633b39c0de257764 2023-09-25 22:03:08,167 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71d8d6b63c95e6f3ec85e26e0aa4a6c4 2023-09-25 22:03:08,168 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/recovered.edits/12.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60/recovered.edits/12.seqid 2023-09-25 22:03:08,168 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b6611ff373502c11c8277c0f32a0c60 2023-09-25 22:03:08,168 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-25 22:03:08,170 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,172 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,174 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-25 22:03:08,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:08,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:08,175 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-25 22:03:08,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:08,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:08,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-25 22:03:08,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679388176"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:08,177 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-25 22:03:08,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b6611ff373502c11c8277c0f32a0c60, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695679373989.0b6611ff373502c11c8277c0f32a0c60.', STARTKEY => '', ENDKEY => ''}] 2023-09-25 22:03:08,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-25 22:03:08,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679388177"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:08,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-25 22:03:08,182 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 39 msec 2023-09-25 22:03:08,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-25 22:03:08,278 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-25 22:03:08,279 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-25 22:03:08,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679388287"}]},"ts":"1695679388287"} 2023-09-25 22:03:08,289 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-25 22:03:08,299 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-25 22:03:08,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, UNASSIGN}] 2023-09-25 22:03:08,303 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, UNASSIGN 2023-09-25 22:03:08,304 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, UNASSIGN 2023-09-25 22:03:08,305 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ab63147b79a49729566e03a372376471, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:08,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=419c904f9465a7e1943cd50a1f549f7d, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:08,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679388305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679388305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679388305"}]},"ts":"1695679388305"} 2023-09-25 22:03:08,305 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679388305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679388305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679388305"}]},"ts":"1695679388305"} 2023-09-25 22:03:08,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 419c904f9465a7e1943cd50a1f549f7d, server=jenkins-hbase16.apache.org,40943,1695679301586}] 2023-09-25 22:03:08,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure ab63147b79a49729566e03a372376471, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:03:08,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-25 22:03:08,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:03:08,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 419c904f9465a7e1943cd50a1f549f7d, disabling compactions & flushes 2023-09-25 22:03:08,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:03:08,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:03:08,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. after waiting 0 ms 2023-09-25 22:03:08,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:03:08,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close ab63147b79a49729566e03a372376471 2023-09-25 22:03:08,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ab63147b79a49729566e03a372376471, disabling compactions & flushes 2023-09-25 22:03:08,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:03:08,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:03:08,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. after waiting 0 ms 2023-09-25 22:03:08,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:03:08,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:08,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:08,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d. 2023-09-25 22:03:08,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:08,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 419c904f9465a7e1943cd50a1f549f7d: 2023-09-25 22:03:08,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:08,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471. 2023-09-25 22:03:08,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ab63147b79a49729566e03a372376471: 2023-09-25 22:03:08,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:03:08,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=419c904f9465a7e1943cd50a1f549f7d, regionState=CLOSED 2023-09-25 22:03:08,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679388485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679388485"}]},"ts":"1695679388485"} 2023-09-25 22:03:08,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed ab63147b79a49729566e03a372376471 2023-09-25 22:03:08,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ab63147b79a49729566e03a372376471, regionState=CLOSED 2023-09-25 22:03:08,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695679388485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679388485"}]},"ts":"1695679388485"} 2023-09-25 22:03:08,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-25 22:03:08,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 419c904f9465a7e1943cd50a1f549f7d, server=jenkins-hbase16.apache.org,40943,1695679301586 in 178 msec 2023-09-25 22:03:08,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-25 22:03:08,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure ab63147b79a49729566e03a372376471, server=jenkins-hbase16.apache.org,37003,1695679301677 in 176 msec 2023-09-25 22:03:08,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=419c904f9465a7e1943cd50a1f549f7d, UNASSIGN in 188 msec 2023-09-25 22:03:08,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-25 22:03:08,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ab63147b79a49729566e03a372376471, UNASSIGN in 189 msec 2023-09-25 22:03:08,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679388490"}]},"ts":"1695679388490"} 2023-09-25 22:03:08,491 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-25 22:03:08,499 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-25 22:03:08,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 218 msec 2023-09-25 22:03:08,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-25 22:03:08,591 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-25 22:03:08,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,596 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,597 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,599 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,603 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:03:08,603 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:03:08,605 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/recovered.edits] 2023-09-25 22:03:08,605 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/recovered.edits] 2023-09-25 22:03:08,609 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/cf/9453375a6eaa481a95d945dc79efe4a9 2023-09-25 22:03:08,609 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/cf/948704085ac841cca0b137e18ab5a759 2023-09-25 22:03:08,612 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d/recovered.edits/9.seqid 2023-09-25 22:03:08,612 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471/recovered.edits/9.seqid 2023-09-25 22:03:08,613 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/419c904f9465a7e1943cd50a1f549f7d 2023-09-25 22:03:08,613 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ab63147b79a49729566e03a372376471 2023-09-25 22:03:08,613 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-25 22:03:08,613 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-25 22:03:08,614 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-25 22:03:08,615 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,615 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,615 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,615 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-25 22:03:08,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-25 22:03:08,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-25 22:03:08,616 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-25 22:03:08,617 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309251a6cf3589f6041879b5140f6fa2a7a9e 2023-09-25 22:03:08,617 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230925012952c574c44536afe397bb6943dc1a 2023-09-25 22:03:08,618 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-25 22:03:08,619 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,621 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-25 22:03:08,623 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,624 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:08,624 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,624 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-25 22:03:08,624 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679388624"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:08,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-25 22:03:08,625 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679388624"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:08,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:03:08,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 419c904f9465a7e1943cd50a1f549f7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695679372559.419c904f9465a7e1943cd50a1f549f7d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ab63147b79a49729566e03a372376471, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695679372559.ab63147b79a49729566e03a372376471.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:03:08,626 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-25 22:03:08,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679388626"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:08,627 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-25 22:03:08,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 40 msec 2023-09-25 22:03:08,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-25 22:03:08,726 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-25 22:03:08,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-25 22:03:08,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-25 22:03:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-25 22:03:08,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-25 22:03:08,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-25 22:03:08,778 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 752) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:57674 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:44809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3955 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:57682 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:37563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_350642235_1 at /127.0.0.1:57652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_350642235_1 at /127.0.0.1:45292 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:45304 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:43720 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 200), ProcessCount=167 (was 168), AvailableMemoryMB=3905 (was 4025) 2023-09-25 22:03:08,778 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-25 22:03:08,797 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=167, AvailableMemoryMB=3904 2023-09-25 22:03:08,797 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-25 22:03:08,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:03:08,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:08,802 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:03:08,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-25 22:03:08,803 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:03:08,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-25 22:03:08,805 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:08,805 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:08,805 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 empty. 2023-09-25 22:03:08,805 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 empty. 2023-09-25 22:03:08,805 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:08,806 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:08,806 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-25 22:03:08,815 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-25 22:03:08,816 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15071cd262c708331aff6dd7676f8dc8, NAME => 'testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:03:08,816 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b739c8c43b42ec3a15d754fe13f3e01, NAME => 'testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 15071cd262c708331aff6dd7676f8dc8, disabling compactions & flushes 2023-09-25 22:03:08,835 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. after waiting 0 ms 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:08,835 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:08,835 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 15071cd262c708331aff6dd7676f8dc8: 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9b739c8c43b42ec3a15d754fe13f3e01, disabling compactions & flushes 2023-09-25 22:03:08,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. after waiting 0 ms 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:08,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:08,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9b739c8c43b42ec3a15d754fe13f3e01: 2023-09-25 22:03:08,838 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:03:08,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679388839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679388839"}]},"ts":"1695679388839"} 2023-09-25 22:03:08,840 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679388839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679388839"}]},"ts":"1695679388839"} 2023-09-25 22:03:08,841 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:03:08,842 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:03:08,842 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679388842"}]},"ts":"1695679388842"} 2023-09-25 22:03:08,844 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-25 22:03:08,857 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:03:08,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:03:08,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:03:08,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:03:08,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:03:08,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, ASSIGN}] 2023-09-25 22:03:08,861 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, ASSIGN 2023-09-25 22:03:08,861 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, ASSIGN 2023-09-25 22:03:08,862 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,37003,1695679301677; forceNewPlan=false, retain=false 2023-09-25 22:03:08,862 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:03:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-25 22:03:09,012 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:03:09,019 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=15071cd262c708331aff6dd7676f8dc8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9b739c8c43b42ec3a15d754fe13f3e01, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679389019"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679389019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679389019"}]},"ts":"1695679389019"} 2023-09-25 22:03:09,020 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679389019"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679389019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679389019"}]},"ts":"1695679389019"} 2023-09-25 22:03:09,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 15071cd262c708331aff6dd7676f8dc8, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:03:09,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 9b739c8c43b42ec3a15d754fe13f3e01, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:03:09,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-25 22:03:09,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15071cd262c708331aff6dd7676f8dc8, NAME => 'testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:03:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b739c8c43b42ec3a15d754fe13f3e01, NAME => 'testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. service=AccessControlService 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. service=AccessControlService 2023-09-25 22:03:09,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:03:09,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,189 INFO [StoreOpener-9b739c8c43b42ec3a15d754fe13f3e01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,190 INFO [StoreOpener-15071cd262c708331aff6dd7676f8dc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,191 DEBUG [StoreOpener-9b739c8c43b42ec3a15d754fe13f3e01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf 2023-09-25 22:03:09,191 DEBUG [StoreOpener-9b739c8c43b42ec3a15d754fe13f3e01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf 2023-09-25 22:03:09,191 DEBUG [StoreOpener-15071cd262c708331aff6dd7676f8dc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf 2023-09-25 22:03:09,191 DEBUG [StoreOpener-15071cd262c708331aff6dd7676f8dc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf 2023-09-25 22:03:09,191 INFO [StoreOpener-9b739c8c43b42ec3a15d754fe13f3e01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b739c8c43b42ec3a15d754fe13f3e01 columnFamilyName cf 2023-09-25 22:03:09,192 INFO [StoreOpener-15071cd262c708331aff6dd7676f8dc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15071cd262c708331aff6dd7676f8dc8 columnFamilyName cf 2023-09-25 22:03:09,193 INFO [StoreOpener-9b739c8c43b42ec3a15d754fe13f3e01-1] regionserver.HStore(310): Store=9b739c8c43b42ec3a15d754fe13f3e01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:03:09,193 INFO [StoreOpener-15071cd262c708331aff6dd7676f8dc8-1] regionserver.HStore(310): Store=15071cd262c708331aff6dd7676f8dc8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:03:09,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:09,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:09,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:03:09,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 9b739c8c43b42ec3a15d754fe13f3e01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68557973, jitterRate=0.021593406796455383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:03:09,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 9b739c8c43b42ec3a15d754fe13f3e01: 2023-09-25 22:03:09,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01., pid=94, masterSystemTime=1695679389179 2023-09-25 22:03:09,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:03:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 15071cd262c708331aff6dd7676f8dc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70476499, jitterRate=0.05018167197704315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:03:09,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 15071cd262c708331aff6dd7676f8dc8: 2023-09-25 22:03:09,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9b739c8c43b42ec3a15d754fe13f3e01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8., pid=93, masterSystemTime=1695679389177 2023-09-25 22:03:09,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679389200"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679389200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679389200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679389200"}]},"ts":"1695679389200"} 2023-09-25 22:03:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=15071cd262c708331aff6dd7676f8dc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679389202"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679389202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679389202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679389202"}]},"ts":"1695679389202"} 2023-09-25 22:03:09,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-25 22:03:09,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 9b739c8c43b42ec3a15d754fe13f3e01, server=jenkins-hbase16.apache.org,37003,1695679301677 in 176 msec 2023-09-25 22:03:09,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, ASSIGN in 345 msec 2023-09-25 22:03:09,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-25 22:03:09,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 15071cd262c708331aff6dd7676f8dc8, server=jenkins-hbase16.apache.org,33807,1695679301636 in 179 msec 2023-09-25 22:03:09,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-25 22:03:09,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, ASSIGN in 347 msec 2023-09-25 22:03:09,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:03:09,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679389206"}]},"ts":"1695679389206"} 2023-09-25 22:03:09,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-25 22:03:09,233 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:03:09,233 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-25 22:03:09,235 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:03:09,240 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:09,240 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:09,240 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:09,240 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:09,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 450 msec 2023-09-25 22:03:09,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-25 22:03:09,410 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-25 22:03:09,412 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:09,412 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,414 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:03:09,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679389428 (current time:1695679389428). 2023-09-25 22:03:09,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:03:09,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x2fe44fb8 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:09,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@659922cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:09,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,456 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fe44fb8 to 127.0.0.1:60419 2023-09-25 22:03:09,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:09,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x21ae9e80 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:09,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cba9c82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:09,476 DEBUG [hconnection-0x19549b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,480 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,488 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:50118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21ae9e80 to 127.0.0.1:60419 2023-09-25 22:03:09,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:09,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:03:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:03:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,493 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,494 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695679989494 2023-09-25 22:03:09,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:09,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,496 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:03:09,497 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:03:09,497 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:09,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-25 22:03:09,502 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:09,502 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695679989502 2023-09-25 22:03:09,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,510 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-25 22:03:09,510 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-25 22:03:09,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-25 22:03:09,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,511 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,538 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,538 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,538 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,538 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,539 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,539 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,541 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,541 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,541 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,541 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,543 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,543 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,545 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,545 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,541 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,544 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,545 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,545 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,547 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,547 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,547 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,557 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,557 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,565 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,574 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,574 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3555e75a[Count = 1] remaining members to acquire global barrier 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-25 22:03:09,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3555e75a[Count = 0] remaining members to acquire global barrier 2023-09-25 22:03:09,579 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-25 22:03:09,579 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,582 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,582 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,582 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:03:09,583 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,583 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:03:09,583 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,583 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. started... 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:09,583 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b739c8c43b42ec3a15d754fe13f3e01: 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. started... 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15071cd262c708331aff6dd7676f8dc8: 2023-09-25 22:03:09,585 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:03:09,586 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,586 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:09,586 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:03:09,590 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:09,590 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:09,590 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:09,598 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:03:09,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:03:09,600 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:03:09,601 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. completed. 2023-09-25 22:03:09,601 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. completed. 2023-09-25 22:03:09,601 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,601 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:09,601 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:03:09,607 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:09,607 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,607 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,607 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:09,615 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,615 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:09,615 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:09,615 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:09,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:03:09,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-25 22:03:09,621 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-25 22:03:09,621 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:03:09,621 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:03:09,621 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,621 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,633 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,634 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,635 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,635 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,636 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:09,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,640 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:03:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,642 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,642 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,642 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:09,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,643 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:03:09,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-25 22:03:09,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,671 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695679389494Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695679389649 (+155 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695679389649Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695679389649Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695679389652 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695679389663 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695679389671 (+8 ms) 2023-09-25 22:03:09,674 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:09,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 179 msec 2023-09-25 22:03:09,800 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:09,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:03:09,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:03:09,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33807] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:03:09,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37003] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:03:09,811 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:09,811 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,812 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:03:09,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679389821 (current time:1695679389821). 2023-09-25 22:03:09,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:03:09,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x1483f415 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:09,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef4c792, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,840 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1483f415 to 127.0.0.1:60419 2023-09-25 22:03:09,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:09,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x75c9c7e2 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:09,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ee1b612, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:09,860 DEBUG [hconnection-0x651260b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,861 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:46134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:09,869 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:50132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:09,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75c9c7e2 to 127.0.0.1:60419 2023-09-25 22:03:09,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:09,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-25 22:03:09,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:03:09,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,876 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,877 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695679989877 2023-09-25 22:03:09,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-25 22:03:09,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:09,879 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:03:09,879 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:03:09,881 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-25 22:03:09,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:09,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-25 22:03:09,884 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:09,885 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695679989885 2023-09-25 22:03:09,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,897 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-25 22:03:09,897 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,898 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-25 22:03:09,898 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-25 22:03:09,899 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,899 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,907 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,907 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,907 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,907 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,908 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,908 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,908 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,909 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:03:09,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-25 22:03:09,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,910 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,910 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,910 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,910 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,912 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,913 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,913 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,913 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,913 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,910 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-25 22:03:09,914 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:09,914 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-25 22:03:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-25 22:03:09,919 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-25 22:03:09,924 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,924 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,952 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,952 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,953 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,952 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,952 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,953 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,953 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,954 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,954 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-25 22:03:09,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e5e0470[Count = 1] remaining members to acquire global barrier 2023-09-25 22:03:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:09,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:09,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:09,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:09,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:09,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-25 22:03:09,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e5e0470[Count = 0] remaining members to acquire global barrier 2023-09-25 22:03:09,965 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-25 22:03:09,965 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,974 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:09,974 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:03:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:09,974 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:09,975 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,974 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-25 22:03:09,975 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:09,975 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:09,975 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:09,975 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:09,975 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:09,975 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:03:09,975 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:09,975 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:09,975 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. started... 2023-09-25 22:03:09,975 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. started... 2023-09-25 22:03:09,976 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15071cd262c708331aff6dd7676f8dc8 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-25 22:03:09,976 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b739c8c43b42ec3a15d754fe13f3e01 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-25 22:03:09,980 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:09,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:03:09,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:03:09,982 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:03:09,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:09,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:09,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:09,998 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be 2023-09-25 22:03:09,998 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526 2023-09-25 22:03:10,005 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/.tmp/cf/8c3465dc4c16458585b40f33949e0036 2023-09-25 22:03:10,006 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/.tmp/cf/1f512d22475446a5971463a286b119bf 2023-09-25 22:03:10,011 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/.tmp/cf/1f512d22475446a5971463a286b119bf as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf 2023-09-25 22:03:10,011 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/.tmp/cf/8c3465dc4c16458585b40f33949e0036 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036 2023-09-25 22:03:10,015 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf, entries=2, sequenceid=6, filesize=5.2 K 2023-09-25 22:03:10,015 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036, entries=48, sequenceid=6, filesize=13.2 K 2023-09-25 22:03:10,016 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 15071cd262c708331aff6dd7676f8dc8 in 40ms, sequenceid=6, compaction requested=false 2023-09-25 22:03:10,016 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-25 22:03:10,016 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9b739c8c43b42ec3a15d754fe13f3e01 in 40ms, sequenceid=6, compaction requested=false 2023-09-25 22:03:10,016 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-25 22:03:10,018 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15071cd262c708331aff6dd7676f8dc8: 2023-09-25 22:03:10,018 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b739c8c43b42ec3a15d754fe13f3e01: 2023-09-25 22:03:10,018 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,018 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,018 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:10,020 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:10,020 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf] hfiles 2023-09-25 22:03:10,020 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,020 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036] hfiles 2023-09-25 22:03:10,020 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,034 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. completed. 2023-09-25 22:03:10,035 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:10,035 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. completed. 2023-09-25 22:03:10,035 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-25 22:03:10,035 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:03:10,040 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:10,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,040 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-25 22:03:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:10,040 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:10,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,040 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:10,040 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:10,042 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-25 22:03:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:03:10,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-25 22:03:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:03:10,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-25 22:03:10,049 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-25 22:03:10,049 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:03:10,049 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:03:10,050 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,050 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,058 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,060 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:10,060 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,060 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:10,065 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:10,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:10,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:10,065 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:10,067 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,068 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:10,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be] mob files 2023-09-25 22:03:10,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526 2023-09-25 22:03:10,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be 2023-09-25 22:03:10,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-25 22:03:10,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,091 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695679389877Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695679390075 (+198 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695679390075Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695679390075Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695679390077 (+2 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695679390084 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695679390090 (+6 ms) 2023-09-25 22:03:10,093 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-25 22:03:10,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 214 msec 2023-09-25 22:03:10,182 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:10,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-25 22:03:10,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:03:10,185 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185 2023-09-25 22:03:10,186 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44421, tgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185, rawTgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:03:10,208 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:03:10,208 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-607838466_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,208 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-25 22:03:10,213 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:10,229 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,230 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,230 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,231 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,928 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-8625503632432630634.jar 2023-09-25 22:03:10,928 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,929 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,982 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-7976499008335263362.jar 2023-09-25 22:03:10,982 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,982 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,983 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,983 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,983 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,984 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:10,984 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:03:10,984 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:03:10,984 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:03:10,985 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:03:10,985 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:03:10,985 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:03:10,986 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:03:10,986 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:03:10,986 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:03:10,987 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:03:10,987 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:10,987 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:10,988 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:10,988 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:10,988 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:10,989 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:10,989 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:11,339 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:03:11,340 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-25 22:03:12,343 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:03:12,343 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:03:12,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0005_000001 (auth:SIMPLE) 2023-09-25 22:03:13,144 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0006_000001 (auth:SIMPLE) 2023-09-25 22:03:13,635 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:03:16,439 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0006_000001 (auth:SIMPLE) 2023-09-25 22:03:18,684 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:03:18,685 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:03:18,690 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:18,690 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:03:18,690 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:03:18,690 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:18,691 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-25 22:03:18,691 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-25 22:03:18,691 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:18,691 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-25 22:03:18,691 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679390185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-25 22:03:18,696 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-25 22:03:18,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testEmptyExportFileSystemState 2023-09-25 22:03:18,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:18,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-25 22:03:18,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679398699"}]},"ts":"1695679398699"} 2023-09-25 22:03:18,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-25 22:03:18,775 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-25 22:03:18,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, UNASSIGN}] 2023-09-25 22:03:18,779 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, UNASSIGN 2023-09-25 22:03:18,779 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, UNASSIGN 2023-09-25 22:03:18,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9b739c8c43b42ec3a15d754fe13f3e01, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:18,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=15071cd262c708331aff6dd7676f8dc8, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:18,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679398780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679398780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679398780"}]},"ts":"1695679398780"} 2023-09-25 22:03:18,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679398780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679398780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679398780"}]},"ts":"1695679398780"} 2023-09-25 22:03:18,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 9b739c8c43b42ec3a15d754fe13f3e01, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:03:18,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 15071cd262c708331aff6dd7676f8dc8, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:03:18,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-25 22:03:18,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:18,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 9b739c8c43b42ec3a15d754fe13f3e01, disabling compactions & flushes 2023-09-25 22:03:18,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:18,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:18,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. after waiting 0 ms 2023-09-25 22:03:18,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:18,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:18,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 15071cd262c708331aff6dd7676f8dc8, disabling compactions & flushes 2023-09-25 22:03:18,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:18,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:18,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. after waiting 0 ms 2023-09-25 22:03:18,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:18,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:18,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:18,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:18,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:18,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01. 2023-09-25 22:03:18,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 9b739c8c43b42ec3a15d754fe13f3e01: 2023-09-25 22:03:18,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8. 2023-09-25 22:03:18,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 15071cd262c708331aff6dd7676f8dc8: 2023-09-25 22:03:18,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:18,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=15071cd262c708331aff6dd7676f8dc8, regionState=CLOSED 2023-09-25 22:03:18,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:18,957 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679398957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679398957"}]},"ts":"1695679398957"} 2023-09-25 22:03:18,957 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9b739c8c43b42ec3a15d754fe13f3e01, regionState=CLOSED 2023-09-25 22:03:18,957 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695679398957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679398957"}]},"ts":"1695679398957"} 2023-09-25 22:03:18,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-25 22:03:18,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 15071cd262c708331aff6dd7676f8dc8, server=jenkins-hbase16.apache.org,33807,1695679301636 in 176 msec 2023-09-25 22:03:18,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-25 22:03:18,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 9b739c8c43b42ec3a15d754fe13f3e01, server=jenkins-hbase16.apache.org,37003,1695679301677 in 178 msec 2023-09-25 22:03:18,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15071cd262c708331aff6dd7676f8dc8, UNASSIGN in 185 msec 2023-09-25 22:03:18,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-25 22:03:18,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9b739c8c43b42ec3a15d754fe13f3e01, UNASSIGN in 185 msec 2023-09-25 22:03:18,962 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679398961"}]},"ts":"1695679398961"} 2023-09-25 22:03:18,963 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-25 22:03:18,973 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-25 22:03:18,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 278 msec 2023-09-25 22:03:19,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-25 22:03:19,002 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-25 22:03:19,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,008 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,012 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,016 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:19,016 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:19,017 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/recovered.edits] 2023-09-25 22:03:19,017 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/recovered.edits] 2023-09-25 22:03:19,020 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/cf/8c3465dc4c16458585b40f33949e0036 2023-09-25 22:03:19,020 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/cf/1f512d22475446a5971463a286b119bf 2023-09-25 22:03:19,023 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01/recovered.edits/9.seqid 2023-09-25 22:03:19,023 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8/recovered.edits/9.seqid 2023-09-25 22:03:19,023 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/9b739c8c43b42ec3a15d754fe13f3e01 2023-09-25 22:03:19,023 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testEmptyExportFileSystemState/15071cd262c708331aff6dd7676f8dc8 2023-09-25 22:03:19,023 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-25 22:03:19,024 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-25 22:03:19,024 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-25 22:03:19,027 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092500d67787bae84066b1216cfecbb13526 2023-09-25 22:03:19,028 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092585eb6bbcfd9b4a84b187140f62d928be 2023-09-25 22:03:19,029 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-25 22:03:19,030 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,031 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,032 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,032 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,032 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-25 22:03:19,032 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-25 22:03:19,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-25 22:03:19,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-25 22:03:19,034 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-25 22:03:19,035 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,035 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-25 22:03:19,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679399035"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:19,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679399035"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:19,037 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:03:19,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15071cd262c708331aff6dd7676f8dc8, NAME => 'testtb-testEmptyExportFileSystemState,,1695679388799.15071cd262c708331aff6dd7676f8dc8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b739c8c43b42ec3a15d754fe13f3e01, NAME => 'testtb-testEmptyExportFileSystemState,1,1695679388799.9b739c8c43b42ec3a15d754fe13f3e01.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:03:19,037 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-25 22:03:19,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679399037"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:19,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,040 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-25 22:03:19,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-25 22:03:19,049 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-25 22:03:19,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-09-25 22:03:19,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-25 22:03:19,144 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-25 22:03:19,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-25 22:03:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:19,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-25 22:03:19,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-25 22:03:19,184 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 763) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:37827 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:37306 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:46383 from appattempt_1695679308029_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:58600 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-122879456_1 at /127.0.0.1:37262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-122879456_1 at /127.0.0.1:53354 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:38049 from appattempt_1695679308029_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:53378 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=945 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 200), ProcessCount=167 (was 167), AvailableMemoryMB=3822 (was 3904) 2023-09-25 22:03:19,184 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-25 22:03:19,200 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=945, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=167, AvailableMemoryMB=3821 2023-09-25 22:03:19,201 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-25 22:03:19,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-25 22:03:19,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-25 22:03:19,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-25 22:03:19,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-25 22:03:19,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-25 22:03:19,208 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,208 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,208 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 empty. 2023-09-25 22:03:19,208 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 empty. 2023-09-25 22:03:19,209 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,209 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,209 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-25 22:03:19,218 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-25 22:03:19,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ebd2683806d6ffccd71b491e870eab07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:03:19,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => ac5d7f7a8cf889be0970e54abfec53d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp 2023-09-25 22:03:19,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:19,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ebd2683806d6ffccd71b491e870eab07, disabling compactions & flushes 2023-09-25 22:03:19,239 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. after waiting 0 ms 2023-09-25 22:03:19,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ebd2683806d6ffccd71b491e870eab07: 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing ac5d7f7a8cf889be0970e54abfec53d3, disabling compactions & flushes 2023-09-25 22:03:19,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. after waiting 0 ms 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for ac5d7f7a8cf889be0970e54abfec53d3: 2023-09-25 22:03:19,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-25 22:03:19,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679399244"}]},"ts":"1695679399244"} 2023-09-25 22:03:19,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679399244"}]},"ts":"1695679399244"} 2023-09-25 22:03:19,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-25 22:03:19,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-25 22:03:19,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679399247"}]},"ts":"1695679399247"} 2023-09-25 22:03:19,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-25 22:03:19,265 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-09-25 22:03:19,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-25 22:03:19,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-25 22:03:19,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-25 22:03:19,266 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-25 22:03:19,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, ASSIGN}] 2023-09-25 22:03:19,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, ASSIGN 2023-09-25 22:03:19,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, ASSIGN 2023-09-25 22:03:19,270 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,37003,1695679301677; forceNewPlan=false, retain=false 2023-09-25 22:03:19,270 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,33807,1695679301636; forceNewPlan=false, retain=false 2023-09-25 22:03:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-25 22:03:19,420 INFO [jenkins-hbase16:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-25 22:03:19,423 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ac5d7f7a8cf889be0970e54abfec53d3, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,423 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ebd2683806d6ffccd71b491e870eab07, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,423 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399422"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679399422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679399422"}]},"ts":"1695679399422"} 2023-09-25 22:03:19,423 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399422"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679399422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679399422"}]},"ts":"1695679399422"} 2023-09-25 22:03:19,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure ac5d7f7a8cf889be0970e54abfec53d3, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:03:19,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ebd2683806d6ffccd71b491e870eab07, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:03:19,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-25 22:03:19,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebd2683806d6ffccd71b491e870eab07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.', STARTKEY => '', ENDKEY => '1'} 2023-09-25 22:03:19,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac5d7f7a8cf889be0970e54abfec53d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.', STARTKEY => '1', ENDKEY => ''} 2023-09-25 22:03:19,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. service=AccessControlService 2023-09-25 22:03:19,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. service=AccessControlService 2023-09-25 22:03:19,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:03:19,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-25 22:03:19,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,587 INFO [StoreOpener-ac5d7f7a8cf889be0970e54abfec53d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,587 INFO [StoreOpener-ebd2683806d6ffccd71b491e870eab07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,588 DEBUG [StoreOpener-ac5d7f7a8cf889be0970e54abfec53d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf 2023-09-25 22:03:19,588 DEBUG [StoreOpener-ac5d7f7a8cf889be0970e54abfec53d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf 2023-09-25 22:03:19,588 DEBUG [StoreOpener-ebd2683806d6ffccd71b491e870eab07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf 2023-09-25 22:03:19,588 DEBUG [StoreOpener-ebd2683806d6ffccd71b491e870eab07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf 2023-09-25 22:03:19,589 INFO [StoreOpener-ac5d7f7a8cf889be0970e54abfec53d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac5d7f7a8cf889be0970e54abfec53d3 columnFamilyName cf 2023-09-25 22:03:19,589 INFO [StoreOpener-ebd2683806d6ffccd71b491e870eab07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebd2683806d6ffccd71b491e870eab07 columnFamilyName cf 2023-09-25 22:03:19,590 INFO [StoreOpener-ebd2683806d6ffccd71b491e870eab07-1] regionserver.HStore(310): Store=ebd2683806d6ffccd71b491e870eab07/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:03:19,590 INFO [StoreOpener-ac5d7f7a8cf889be0970e54abfec53d3-1] regionserver.HStore(310): Store=ac5d7f7a8cf889be0970e54abfec53d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-25 22:03:19,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:19,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:19,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:03:19,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-25 22:03:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ac5d7f7a8cf889be0970e54abfec53d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73046554, jitterRate=0.08847847580909729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:03:19,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ac5d7f7a8cf889be0970e54abfec53d3: 2023-09-25 22:03:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ebd2683806d6ffccd71b491e870eab07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67011365, jitterRate=-0.0014528483152389526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-25 22:03:19,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ebd2683806d6ffccd71b491e870eab07: 2023-09-25 22:03:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3., pid=108, masterSystemTime=1695679399576 2023-09-25 22:03:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07., pid=109, masterSystemTime=1695679399576 2023-09-25 22:03:19,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ebd2683806d6ffccd71b491e870eab07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:19,597 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399597"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679399597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679399597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679399597"}]},"ts":"1695679399597"} 2023-09-25 22:03:19,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ac5d7f7a8cf889be0970e54abfec53d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679399597"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695679399597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695679399597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695679399597"}]},"ts":"1695679399597"} 2023-09-25 22:03:19,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-25 22:03:19,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ebd2683806d6ffccd71b491e870eab07, server=jenkins-hbase16.apache.org,33807,1695679301636 in 173 msec 2023-09-25 22:03:19,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-25 22:03:19,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure ac5d7f7a8cf889be0970e54abfec53d3, server=jenkins-hbase16.apache.org,37003,1695679301677 in 175 msec 2023-09-25 22:03:19,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, ASSIGN in 332 msec 2023-09-25 22:03:19,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-25 22:03:19,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, ASSIGN in 333 msec 2023-09-25 22:03:19,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-25 22:03:19,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679399601"}]},"ts":"1695679399601"} 2023-09-25 22:03:19,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-25 22:03:19,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-25 22:03:19,633 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-25 22:03:19,635 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-25 22:03:19,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,640 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:19,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:19,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:19,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:19,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-25 22:03:19,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 447 msec 2023-09-25 22:03:19,719 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-25 22:03:19,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-25 22:03:19,812 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-25 22:03:19,815 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,815 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:19,817 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:03:19,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679399832 (current time:1695679399832). 2023-09-25 22:03:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:03:19,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x509471cb to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:19,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3157df5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:19,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:19,855 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x509471cb to 127.0.0.1:60419 2023-09-25 22:03:19,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:19,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x2aa88c58 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59c1baef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:19,878 DEBUG [hconnection-0x56631b8b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:19,883 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:19,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:19,893 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:19,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aa88c58 to 127.0.0.1:60419 2023-09-25 22:03:19,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-25 22:03:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:03:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:19,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:19,898 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:19,899 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695679999899 2023-09-25 22:03:19,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:19,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,901 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:03:19,901 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:03:19,902 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:19,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:19,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-25 22:03:19,905 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:19,905 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695679999905 2023-09-25 22:03:19,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,915 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-25 22:03:19,915 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:19,917 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-25 22:03:19,917 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-25 22:03:19,917 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,917 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,946 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:19,946 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,946 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:19,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:19,946 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,947 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,947 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,947 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:03:19,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:19,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:19,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,949 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:19,949 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:19,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,949 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:19,949 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:19,951 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:19,951 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:19,949 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:19,951 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:19,951 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:19,953 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:19,953 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:19,954 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:19,955 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:19,954 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:19,955 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:19,965 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,965 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:19,973 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,973 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,982 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:19,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:19,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b0f06bb[Count = 1] remaining members to acquire global barrier 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:19,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:19,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:19,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:19,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-25 22:03:19,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b0f06bb[Count = 0] remaining members to acquire global barrier 2023-09-25 22:03:19,990 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-25 22:03:19,990 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,998 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,998 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,998 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:19,999 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:03:19,999 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:19,999 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:19,999 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,000 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:03:20,000 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:20,000 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:20,000 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:20,000 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:20,000 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:20,000 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:20,000 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. started... 2023-09-25 22:03:20,000 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. started... 2023-09-25 22:03:20,002 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:20,002 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebd2683806d6ffccd71b491e870eab07: 2023-09-25 22:03:20,002 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac5d7f7a8cf889be0970e54abfec53d3: 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:03:20,003 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-25 22:03:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-25 22:03:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:03:20,005 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:03:20,007 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,007 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,007 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,026 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. completed. 2023-09-25 22:03:20,026 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:20,026 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:20,026 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:20,026 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,026 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:20,026 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:03:20,028 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. completed. 2023-09-25 22:03:20,028 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:20,028 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:20,028 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:20,028 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,028 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:20,028 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:03:20,032 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,032 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,032 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,032 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,040 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,040 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,040 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,040 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:03:20,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-25 22:03:20,048 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-25 22:03:20,048 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:03:20,048 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:03:20,048 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,048 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,057 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,058 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,058 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,060 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,061 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,061 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,073 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,073 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,075 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:03:20,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-25 22:03:20,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-25 22:03:20,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,100 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695679399899Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695679400083 (+184 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695679400083Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695679400083Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695679400086 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695679400093 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695679400100 (+7 ms) 2023-09-25 22:03:20,103 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:20,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 203 msec 2023-09-25 22:03:20,205 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:20,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-25 22:03:20,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:03:20,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33807] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:03:20,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37003] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-25 22:03:20,217 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,218 DEBUG [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:20,218 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-25 22:03:20,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:20,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695679400227 (current time:1695679400227). 2023-09-25 22:03:20,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-25 22:03:20,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x23a0ceb1 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d51260d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:20,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:20,244 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:20,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23a0ceb1 to 127.0.0.1:60419 2023-09-25 22:03:20,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(139): Connect 0x27164be8 to 127.0.0.1:60419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-25 22:03:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266ccfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-25 22:03:20,260 DEBUG [hconnection-0x6663e3f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:20,264 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:54592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:20,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-25 22:03:20,272 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-25 22:03:20,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27164be8 to 127.0.0.1:60419 2023-09-25 22:03:20,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:03:20,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-25 22:03:20,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-25 22:03:20,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:20,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:20,277 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:20,278 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695680000278 2023-09-25 22:03:20,278 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-25 22:03:20,279 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-25 22:03:20,279 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-25 22:03:20,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:20,280 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-25 22:03:20,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-25 22:03:20,282 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:20,283 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695680000283 2023-09-25 22:03:20,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,294 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-25 22:03:20,294 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:20,295 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-25 22:03:20,295 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-25 22:03:20,296 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,296 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,298 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,298 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,298 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,298 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,298 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,298 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,299 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-25 22:03:20,299 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:20,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,300 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:20,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,300 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:20,301 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-25 22:03:20,301 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:20,301 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:20,301 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,40943,1695679301586' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-25 22:03:20,302 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-25 22:03:20,306 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,306 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,338 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,338 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,338 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,338 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,339 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:20,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,339 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,339 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:20,339 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,339 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-25 22:03:20,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,33807,1695679301636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-25 22:03:20,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132690cd[Count = 1] remaining members to acquire global barrier 2023-09-25 22:03:20,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,37003,1695679301677' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-25 22:03:20,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132690cd[Count = 0] remaining members to acquire global barrier 2023-09-25 22:03:20,350 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-25 22:03:20,350 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,365 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,365 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,365 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,366 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:20,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,366 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:20,366 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:20,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,366 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,367 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:20,366 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:20,366 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-25 22:03:20,367 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-25 22:03:20,367 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:20,367 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-25 22:03:20,367 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:20,368 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,40943,1695679301586' in zk 2023-09-25 22:03:20,367 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. started... 2023-09-25 22:03:20,367 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,368 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-25 22:03:20,367 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. started... 2023-09-25 22:03:20,368 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ac5d7f7a8cf889be0970e54abfec53d3 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-25 22:03:20,368 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ebd2683806d6ffccd71b491e870eab07 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-25 22:03:20,373 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,374 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,374 DEBUG [member: 'jenkins-hbase16.apache.org,40943,1695679301586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,379 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:20,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-25 22:03:20,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-25 22:03:20,381 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-25 22:03:20,392 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d 2023-09-25 22:03:20,393 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae 2023-09-25 22:03:20,408 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/.tmp/cf/5fdd2525675c4717b287f5ba79e3e3f7 2023-09-25 22:03:20,408 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/.tmp/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 2023-09-25 22:03:20,412 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/.tmp/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 2023-09-25 22:03:20,412 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/.tmp/cf/5fdd2525675c4717b287f5ba79e3e3f7 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7 2023-09-25 22:03:20,418 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7, entries=2, sequenceid=6, filesize=5.2 K 2023-09-25 22:03:20,418 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3, entries=48, sequenceid=6, filesize=13.5 K 2023-09-25 22:03:20,419 INFO [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ebd2683806d6ffccd71b491e870eab07 in 51ms, sequenceid=6, compaction requested=false 2023-09-25 22:03:20,419 INFO [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ac5d7f7a8cf889be0970e54abfec53d3 in 51ms, sequenceid=6, compaction requested=false 2023-09-25 22:03:20,420 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebd2683806d6ffccd71b491e870eab07: 2023-09-25 22:03:20,420 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac5d7f7a8cf889be0970e54abfec53d3: 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7] hfiles 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3] hfiles 2023-09-25 22:03:20,421 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,437 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. completed. 2023-09-25 22:03:20,437 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. completed. 2023-09-25 22:03:20,437 DEBUG [rs(jenkins-hbase16.apache.org,33807,1695679301636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:20,437 DEBUG [rs(jenkins-hbase16.apache.org,37003,1695679301677)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:20,437 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:20,437 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,33807,1695679301636' in zk 2023-09-25 22:03:20,438 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,37003,1695679301677' in zk 2023-09-25 22:03:20,448 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,448 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,448 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,448 DEBUG [member: 'jenkins-hbase16.apache.org,33807,1695679301636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,457 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-25 22:03:20,457 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,457 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,457 DEBUG [member: 'jenkins-hbase16.apache.org,37003,1695679301677' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-25 22:03:20,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,33807,1695679301636': 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,33807,1695679301636' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,37003,1695679301677': 2023-09-25 22:03:20,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,37003,1695679301677' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-25 22:03:20,464 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-25 22:03:20,464 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-25 22:03:20,464 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-25 22:03:20,464 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,464 INFO [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-25 22:03:20,473 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,473 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-25 22:03:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-25 22:03:20,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,473 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,473 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,473 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-25 22:03:20,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,474 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-25 22:03:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,475 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-25 22:03:20,476 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,476 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,476 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,481 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-25 22:03:20,482 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-25 22:03:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:20,483 DEBUG [(jenkins-hbase16.apache.org,36183,1695679300385)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-25 22:03:20,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,483 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:20,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,484 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,484 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-25 22:03:20,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d] mob files 2023-09-25 22:03:20,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae 2023-09-25 22:03:20,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d 2023-09-25 22:03:20,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-25 22:03:20,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,517 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695679400278Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695679400496 (+218 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695679400496Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695679400496Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695679400501 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695679400509 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695679400516 (+7 ms) 2023-09-25 22:03:20,521 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-25 22:03:20,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 242 msec 2023-09-25 22:03:20,581 DEBUG [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-25 22:03:20,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-25 22:03:20,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-25 22:03:20,582 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582 2023-09-25 22:03:20,582 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44421, tgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582, rawTgtDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582, srcFsUri=hdfs://localhost:44421, srcDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:03:20,604 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15 2023-09-25 22:03:20,604 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-44945201_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,604 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44421, inputRoot=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15, snapshotDir=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-25 22:03:20,611 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:20,628 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:20,628 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:20,629 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:20,629 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,332 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-2124028442658359035.jar 2023-09-25 22:03:21,332 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,332 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,385 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/hadoop-8318842578113938922.jar 2023-09-25 22:03:21,385 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,386 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,386 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,386 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,387 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,387 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-25 22:03:21,387 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-25 22:03:21,388 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-25 22:03:21,388 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-25 22:03:21,388 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-25 22:03:21,389 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-25 22:03:21,389 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-25 22:03:21,390 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-25 22:03:21,390 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-25 22:03:21,391 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-25 22:03:21,392 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-25 22:03:21,392 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:21,393 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:21,393 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:21,394 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:21,394 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-25 22:03:21,395 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:21,395 DEBUG [Listener at jenkins-hbase16.apache.org/37563] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-25 22:03:21,718 WARN [Listener at jenkins-hbase16.apache.org/37563] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-25 22:03:21,721 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-25 22:03:21,723 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-25 22:03:23,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:03:23,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-25 22:03:23,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0006_000001 (auth:SIMPLE) 2023-09-25 22:03:24,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0007_000001 (auth:SIMPLE) 2023-09-25 22:03:24,524 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:03:27,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0007_000001 (auth:SIMPLE) 2023-09-25 22:03:29,877 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0007_000001 (auth:SIMPLE) 2023-09-25 22:03:32,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695679308029_0007_000001 (auth:SIMPLE) 2023-09-25 22:03:33,898 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-25 22:03:33,898 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-25 22:03:33,908 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,908 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-25 22:03:33,908 INFO [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-25 22:03:33,908 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,909 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-25 22:03:33,909 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-25 22:03:33,909 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_89501401_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,910 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-25 22:03:33,910 DEBUG [Listener at jenkins-hbase16.apache.org/37563] snapshot.TestExportSnapshot(367): hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/export-test/export-1695679400582/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-25 22:03:33,916 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:33,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-25 22:03:33,921 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679413921"}]},"ts":"1695679413921"} 2023-09-25 22:03:33,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-25 22:03:33,956 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-25 22:03:33,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, UNASSIGN}] 2023-09-25 22:03:33,961 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, UNASSIGN 2023-09-25 22:03:33,961 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, UNASSIGN 2023-09-25 22:03:33,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ac5d7f7a8cf889be0970e54abfec53d3, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:03:33,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ebd2683806d6ffccd71b491e870eab07, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:03:33,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679413963"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679413963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679413963"}]},"ts":"1695679413963"} 2023-09-25 22:03:33,963 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679413963"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695679413963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695679413963"}]},"ts":"1695679413963"} 2023-09-25 22:03:33,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure ac5d7f7a8cf889be0970e54abfec53d3, server=jenkins-hbase16.apache.org,37003,1695679301677}] 2023-09-25 22:03:33,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure ebd2683806d6ffccd71b491e870eab07, server=jenkins-hbase16.apache.org,33807,1695679301636}] 2023-09-25 22:03:34,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-25 22:03:34,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:34,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:34,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ebd2683806d6ffccd71b491e870eab07, disabling compactions & flushes 2023-09-25 22:03:34,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:34,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ac5d7f7a8cf889be0970e54abfec53d3, disabling compactions & flushes 2023-09-25 22:03:34,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. after waiting 0 ms 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. after waiting 0 ms 2023-09-25 22:03:34,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:03:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:34,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:03:34,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07. 2023-09-25 22:03:34,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3. 2023-09-25 22:03:34,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ac5d7f7a8cf889be0970e54abfec53d3: 2023-09-25 22:03:34,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ebd2683806d6ffccd71b491e870eab07: 2023-09-25 22:03:34,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:34,146 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ebd2683806d6ffccd71b491e870eab07, regionState=CLOSED 2023-09-25 22:03:34,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:34,146 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679414146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679414146"}]},"ts":"1695679414146"} 2023-09-25 22:03:34,147 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ac5d7f7a8cf889be0970e54abfec53d3, regionState=CLOSED 2023-09-25 22:03:34,147 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695679414147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695679414147"}]},"ts":"1695679414147"} 2023-09-25 22:03:34,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-25 22:03:34,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure ebd2683806d6ffccd71b491e870eab07, server=jenkins-hbase16.apache.org,33807,1695679301636 in 181 msec 2023-09-25 22:03:34,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-25 22:03:34,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure ac5d7f7a8cf889be0970e54abfec53d3, server=jenkins-hbase16.apache.org,37003,1695679301677 in 183 msec 2023-09-25 22:03:34,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ebd2683806d6ffccd71b491e870eab07, UNASSIGN in 193 msec 2023-09-25 22:03:34,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-25 22:03:34,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ac5d7f7a8cf889be0970e54abfec53d3, UNASSIGN in 193 msec 2023-09-25 22:03:34,154 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695679414153"}]},"ts":"1695679414153"} 2023-09-25 22:03:34,154 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-25 22:03:34,164 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-25 22:03:34,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 248 msec 2023-09-25 22:03:34,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-25 22:03:34,224 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-25 22:03:34,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,232 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,233 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,235 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33807] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,238 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:34,238 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:34,240 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/recovered.edits] 2023-09-25 22:03:34,240 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf, FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/recovered.edits] 2023-09-25 22:03:34,244 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/cf/5fdd2525675c4717b287f5ba79e3e3f7 2023-09-25 22:03:34,244 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/cf/ab2ce9f92e8c45f983ef8e298cfbe8f3 2023-09-25 22:03:34,246 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07/recovered.edits/9.seqid 2023-09-25 22:03:34,246 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/recovered.edits/9.seqid to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3/recovered.edits/9.seqid 2023-09-25 22:03:34,247 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ebd2683806d6ffccd71b491e870eab07 2023-09-25 22:03:34,247 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ac5d7f7a8cf889be0970e54abfec53d3 2023-09-25 22:03:34,247 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-25 22:03:34,247 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-25 22:03:34,248 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,248 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,248 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,248 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-25 22:03:34,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-25 22:03:34,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-25 22:03:34,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-25 22:03:34,248 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-25 22:03:34,252 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092534f41dfc5c884e6ba95027554611daae 2023-09-25 22:03:34,253 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d to hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092547d7c363b7f540a59fc3a9d8a396e56d 2023-09-25 22:03:34,253 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-25 22:03:34,255 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,256 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-25 22:03:34,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-25 22:03:34,257 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-25 22:03:34,258 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-25 22:03:34,259 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,259 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-25 22:03:34,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679414259"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:34,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695679414259"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:34,261 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-25 22:03:34,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ebd2683806d6ffccd71b491e870eab07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695679399202.ebd2683806d6ffccd71b491e870eab07.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ac5d7f7a8cf889be0970e54abfec53d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695679399202.ac5d7f7a8cf889be0970e54abfec53d3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-25 22:03:34,261 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-25 22:03:34,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695679414261"}]},"ts":"9223372036854775807"} 2023-09-25 22:03:34,262 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-25 22:03:34,273 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 47 msec 2023-09-25 22:03:34,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-25 22:03:34,360 INFO [Listener at jenkins-hbase16.apache.org/37563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-25 22:03:34,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-25 22:03:34,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-25 22:03:34,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-25 22:03:34,411 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-483666131_1 at /127.0.0.1:34826 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:50554 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5331 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:40258 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase16.apache.org/188.40.62.62:42977 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fec2d75-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_89501401_17 at /127.0.0.1:35558 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-483666131_1 at /127.0.0.1:59884 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 945), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 193), ProcessCount=167 (was 167), AvailableMemoryMB=3723 (was 3821) 2023-09-25 22:03:34,411 WARN [Listener at jenkins-hbase16.apache.org/37563] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-25 22:03:34,411 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-25 22:03:34,422 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-09-25 22:03:34,541 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695679308029_0007_01_000001 is : 143 2023-09-25 22:03:39,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-25 22:03:48,564 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-09-25 22:04:02,696 ERROR [Thread[Thread-407,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-25 22:04:02,697 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-09-25 22:04:02,809 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-25 22:04:02,816 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-25 22:04:02,817 ERROR [Thread[Thread-417,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-25 22:04:02,825 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-09-25 22:04:02,929 ERROR [Thread[Thread-382,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-25 22:04:02,930 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-25 22:04:02,930 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-25 22:04:02,930 INFO [Listener at jenkins-hbase16.apache.org/37563] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-25 22:04:02,930 DEBUG [Listener at jenkins-hbase16.apache.org/37563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6194af79 to 127.0.0.1:60419 2023-09-25 22:04:02,930 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:02,930 DEBUG [Listener at jenkins-hbase16.apache.org/37563] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-25 22:04:02,931 DEBUG [Listener at jenkins-hbase16.apache.org/37563] util.JVMClusterUtil(257): Found active master hash=1549007117, stopped=false 2023-09-25 22:04:02,931 DEBUG [Listener at jenkins-hbase16.apache.org/37563] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:02,932 DEBUG [Listener at jenkins-hbase16.apache.org/37563] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-25 22:04:02,932 INFO [Listener at jenkins-hbase16.apache.org/37563] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:04:02,971 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-25 22:04:02,972 INFO [Listener at jenkins-hbase16.apache.org/37563] procedure2.ProcedureExecutor(628): Stopping 2023-09-25 22:04:02,972 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:04:02,971 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-25 22:04:02,971 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-25 22:04:02,971 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-25 22:04:02,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:04:02,972 DEBUG [Listener at jenkins-hbase16.apache.org/37563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55cf400e to 127.0.0.1:60419 2023-09-25 22:04:02,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:04:02,973 DEBUG [Listener at jenkins-hbase16.apache.org/37563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:02,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:04:02,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-25 22:04:02,973 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,40943,1695679301586' ***** 2023-09-25 22:04:02,973 DEBUG [Listener at jenkins-hbase16.apache.org/37563] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:02,974 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-25 22:04:02,974 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,33807,1695679301636' ***** 2023-09-25 22:04:02,974 DEBUG [Listener at jenkins-hbase16.apache.org/37563] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:02,974 INFO [RS:0;jenkins-hbase16:40943] regionserver.HeapMemoryManager(220): Stopping 2023-09-25 22:04:02,974 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-25 22:04:02,975 INFO [RS:0;jenkins-hbase16:40943] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-25 22:04:02,975 INFO [RS:1;jenkins-hbase16:33807] regionserver.HeapMemoryManager(220): Stopping 2023-09-25 22:04:02,975 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-25 22:04:02,975 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-25 22:04:02,975 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,37003,1695679301677' ***** 2023-09-25 22:04:02,975 INFO [RS:1;jenkins-hbase16:33807] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-25 22:04:02,975 DEBUG [Listener at jenkins-hbase16.apache.org/37563] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:02,975 INFO [RS:0;jenkins-hbase16:40943] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-25 22:04:02,976 INFO [Listener at jenkins-hbase16.apache.org/37563] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-25 22:04:02,975 INFO [RS:1;jenkins-hbase16:33807] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-25 22:04:02,976 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:04:02,976 DEBUG [RS:0;jenkins-hbase16:40943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d077fbf to 127.0.0.1:60419 2023-09-25 22:04:02,976 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(3305): Received CLOSE for 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:04:02,976 INFO [RS:2;jenkins-hbase16:37003] regionserver.HeapMemoryManager(220): Stopping 2023-09-25 22:04:02,976 DEBUG [RS:0;jenkins-hbase16:40943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:02,977 INFO [RS:2;jenkins-hbase16:37003] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-25 22:04:02,980 INFO [RS:0;jenkins-hbase16:40943] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-25 22:04:02,980 INFO [RS:0;jenkins-hbase16:40943] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-25 22:04:02,980 INFO [RS:0;jenkins-hbase16:40943] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-25 22:04:02,980 INFO [RS:2;jenkins-hbase16:37003] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-25 22:04:02,980 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:04:02,981 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(3305): Received CLOSE for bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:04:02,979 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-25 22:04:02,981 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:04:02,981 DEBUG [RS:1;jenkins-hbase16:33807] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a89c945 to 127.0.0.1:60419 2023-09-25 22:04:02,981 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-25 22:04:02,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 0d8abea0b5a4e2ea451d705050ff50e4, disabling compactions & flushes 2023-09-25 22:04:02,982 DEBUG [RS:1;jenkins-hbase16:33807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing bba5ce3d3a6a22106640c3b1bd990dd5, disabling compactions & flushes 2023-09-25 22:04:02,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:04:02,983 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-25 22:04:02,982 DEBUG [RS:2;jenkins-hbase16:37003] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6207ec09 to 127.0.0.1:60419 2023-09-25 22:04:02,983 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1478): Online Regions={0d8abea0b5a4e2ea451d705050ff50e4=hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4.} 2023-09-25 22:04:02,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:04:02,983 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-25 22:04:02,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:04:02,984 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-25 22:04:02,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:04:02,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. after waiting 0 ms 2023-09-25 22:04:02,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-25 22:04:02,984 DEBUG [RS:2;jenkins-hbase16:37003] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:02,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-25 22:04:02,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-25 22:04:02,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-25 22:04:02,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-25 22:04:02,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:04:02,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. after waiting 0 ms 2023-09-25 22:04:02,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing bba5ce3d3a6a22106640c3b1bd990dd5 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-25 22:04:02,985 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-25 22:04:02,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-25 22:04:02,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:04:02,985 DEBUG [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1504): Waiting on 0d8abea0b5a4e2ea451d705050ff50e4 2023-09-25 22:04:02,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 0d8abea0b5a4e2ea451d705050ff50e4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-25 22:04:02,985 DEBUG [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-25 22:04:02,985 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1478): Online Regions={bba5ce3d3a6a22106640c3b1bd990dd5=hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5.} 2023-09-25 22:04:02,985 DEBUG [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1504): Waiting on bba5ce3d3a6a22106640c3b1bd990dd5 2023-09-25 22:04:03,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/.tmp/l/8440f588e9874875b8d5c3507a23d9cc 2023-09-25 22:04:03,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/.tmp/info/3224efcbee2f4aed8acd91ff3faebbab 2023-09-25 22:04:03,018 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/info/a9ae0be5801c47fca43cef1fc41e6b73 2023-09-25 22:04:03,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8440f588e9874875b8d5c3507a23d9cc 2023-09-25 22:04:03,029 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9ae0be5801c47fca43cef1fc41e6b73 2023-09-25 22:04:03,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/.tmp/l/8440f588e9874875b8d5c3507a23d9cc as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/l/8440f588e9874875b8d5c3507a23d9cc 2023-09-25 22:04:03,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8440f588e9874875b8d5c3507a23d9cc 2023-09-25 22:04:03,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/l/8440f588e9874875b8d5c3507a23d9cc, entries=7, sequenceid=18, filesize=5.2 K 2023-09-25 22:04:03,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0d8abea0b5a4e2ea451d705050ff50e4 in 50ms, sequenceid=18, compaction requested=false 2023-09-25 22:04:03,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/.tmp/info/3224efcbee2f4aed8acd91ff3faebbab as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/info/3224efcbee2f4aed8acd91ff3faebbab 2023-09-25 22:04:03,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/info/3224efcbee2f4aed8acd91ff3faebbab, entries=2, sequenceid=6, filesize=4.8 K 2023-09-25 22:04:03,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bba5ce3d3a6a22106640c3b1bd990dd5 in 58ms, sequenceid=6, compaction requested=false 2023-09-25 22:04:03,046 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,046 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,047 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/namespace/bba5ce3d3a6a22106640c3b1bd990dd5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-25 22:04:03,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/acl/0d8abea0b5a4e2ea451d705050ff50e4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-25 22:04:03,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:03,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:04:03,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for bba5ce3d3a6a22106640c3b1bd990dd5: 2023-09-25 22:04:03,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695679303841.bba5ce3d3a6a22106640c3b1bd990dd5. 2023-09-25 22:04:03,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:03,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:04:03,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 0d8abea0b5a4e2ea451d705050ff50e4: 2023-09-25 22:04:03,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695679304757.0d8abea0b5a4e2ea451d705050ff50e4. 2023-09-25 22:04:03,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/rep_barrier/942bdc03b69e497986ddf2f7857f2b51 2023-09-25 22:04:03,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 942bdc03b69e497986ddf2f7857f2b51 2023-09-25 22:04:03,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/table/5724c460317a4163b66e103fafe4c8e9 2023-09-25 22:04:03,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5724c460317a4163b66e103fafe4c8e9 2023-09-25 22:04:03,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/info/a9ae0be5801c47fca43cef1fc41e6b73 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/info/a9ae0be5801c47fca43cef1fc41e6b73 2023-09-25 22:04:03,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9ae0be5801c47fca43cef1fc41e6b73 2023-09-25 22:04:03,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/info/a9ae0be5801c47fca43cef1fc41e6b73, entries=48, sequenceid=131, filesize=10.3 K 2023-09-25 22:04:03,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/rep_barrier/942bdc03b69e497986ddf2f7857f2b51 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/rep_barrier/942bdc03b69e497986ddf2f7857f2b51 2023-09-25 22:04:03,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 942bdc03b69e497986ddf2f7857f2b51 2023-09-25 22:04:03,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/rep_barrier/942bdc03b69e497986ddf2f7857f2b51, entries=13, sequenceid=131, filesize=6.4 K 2023-09-25 22:04:03,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/.tmp/table/5724c460317a4163b66e103fafe4c8e9 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/table/5724c460317a4163b66e103fafe4c8e9 2023-09-25 22:04:03,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5724c460317a4163b66e103fafe4c8e9 2023-09-25 22:04:03,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/table/5724c460317a4163b66e103fafe4c8e9, entries=24, sequenceid=131, filesize=6.9 K 2023-09-25 22:04:03,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 123ms, sequenceid=131, compaction requested=false 2023-09-25 22:04:03,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-25 22:04:03,120 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-25 22:04:03,120 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-25 22:04:03,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-25 22:04:03,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-25 22:04:03,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-25 22:04:03,185 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,33807,1695679301636; all regions closed. 2023-09-25 22:04:03,185 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,40943,1695679301586; all regions closed. 2023-09-25 22:04:03,185 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,37003,1695679301677; all regions closed. 2023-09-25 22:04:03,199 DEBUG [RS:1;jenkins-hbase16:33807] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs 2023-09-25 22:04:03,199 DEBUG [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs 2023-09-25 22:04:03,199 INFO [RS:1;jenkins-hbase16:33807] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C33807%2C1695679301636:(num 1695679303417) 2023-09-25 22:04:03,199 DEBUG [RS:2;jenkins-hbase16:37003] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs 2023-09-25 22:04:03,199 DEBUG [RS:1;jenkins-hbase16:33807] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:03,199 INFO [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C40943%2C1695679301586.meta:.meta(num 1695679303551) 2023-09-25 22:04:03,200 INFO [RS:1;jenkins-hbase16:33807] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,200 INFO [RS:2;jenkins-hbase16:37003] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C37003%2C1695679301677:(num 1695679303417) 2023-09-25 22:04:03,200 DEBUG [RS:2;jenkins-hbase16:37003] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:03,200 INFO [RS:2;jenkins-hbase16:37003] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,200 INFO [RS:2;jenkins-hbase16:37003] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-25 22:04:03,200 INFO [RS:1;jenkins-hbase16:33807] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-25 22:04:03,200 INFO [RS:1;jenkins-hbase16:33807] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-25 22:04:03,202 INFO [RS:1;jenkins-hbase16:33807] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-25 22:04:03,202 INFO [RS:1;jenkins-hbase16:33807] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-25 22:04:03,201 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-25 22:04:03,201 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-25 22:04:03,201 INFO [RS:2;jenkins-hbase16:37003] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-25 22:04:03,205 INFO [RS:1;jenkins-hbase16:33807] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:33807 2023-09-25 22:04:03,205 INFO [RS:2;jenkins-hbase16:37003] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-25 22:04:03,205 INFO [RS:2;jenkins-hbase16:37003] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-25 22:04:03,206 INFO [RS:2;jenkins-hbase16:37003] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:37003 2023-09-25 22:04:03,208 DEBUG [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/oldWALs 2023-09-25 22:04:03,208 INFO [RS:0;jenkins-hbase16:40943] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C40943%2C1695679301586:(num 1695679303417) 2023-09-25 22:04:03,208 DEBUG [RS:0;jenkins-hbase16:40943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:03,209 INFO [RS:0;jenkins-hbase16:40943] regionserver.LeaseManager(133): Closed leases 2023-09-25 22:04:03,209 INFO [RS:0;jenkins-hbase16:40943] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-25 22:04:03,209 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-25 22:04:03,210 INFO [RS:0;jenkins-hbase16:40943] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:40943 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,40943,1695679301586 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:04:03,255 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-25 22:04:03,263 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:04:03,263 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:04:03,263 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:04:03,263 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:04:03,263 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,33807,1695679301636] 2023-09-25 22:04:03,263 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,33807,1695679301636 2023-09-25 22:04:03,264 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,37003,1695679301677 2023-09-25 22:04:03,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,33807,1695679301636; numProcessing=1 2023-09-25 22:04:03,280 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,33807,1695679301636 already deleted, retry=false 2023-09-25 22:04:03,280 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,33807,1695679301636 expired; onlineServers=2 2023-09-25 22:04:03,280 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,37003,1695679301677] 2023-09-25 22:04:03,280 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,37003,1695679301677; numProcessing=2 2023-09-25 22:04:03,288 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,37003,1695679301677 already deleted, retry=false 2023-09-25 22:04:03,288 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,37003,1695679301677 expired; onlineServers=1 2023-09-25 22:04:03,288 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,40943,1695679301586] 2023-09-25 22:04:03,288 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,40943,1695679301586; numProcessing=3 2023-09-25 22:04:03,296 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,40943,1695679301586 already deleted, retry=false 2023-09-25 22:04:03,296 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,40943,1695679301586 expired; onlineServers=0 2023-09-25 22:04:03,296 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,36183,1695679300385' ***** 2023-09-25 22:04:03,296 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-25 22:04:03,297 DEBUG [M:0;jenkins-hbase16:36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6ef336, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-09-25 22:04:03,297 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,36183,1695679300385 2023-09-25 22:04:03,297 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,36183,1695679300385; all regions closed. 2023-09-25 22:04:03,297 DEBUG [M:0;jenkins-hbase16:36183] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-25 22:04:03,297 DEBUG [M:0;jenkins-hbase16:36183] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-25 22:04:03,297 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-25 22:04:03,297 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1695679303008] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1695679303008,5,FailOnTimeoutGroup] 2023-09-25 22:04:03,297 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1695679303011] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1695679303011,5,FailOnTimeoutGroup] 2023-09-25 22:04:03,297 DEBUG [M:0;jenkins-hbase16:36183] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-25 22:04:03,297 INFO [M:0;jenkins-hbase16:36183] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-25 22:04:03,298 INFO [M:0;jenkins-hbase16:36183] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-25 22:04:03,298 INFO [M:0;jenkins-hbase16:36183] hbase.ChoreService(369): Chore service for: master/jenkins-hbase16:0 had [] on shutdown 2023-09-25 22:04:03,298 DEBUG [M:0;jenkins-hbase16:36183] master.HMaster(1512): Stopping service threads 2023-09-25 22:04:03,298 INFO [M:0;jenkins-hbase16:36183] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-25 22:04:03,298 ERROR [M:0;jenkins-hbase16:36183] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-25 22:04:03,299 INFO [M:0;jenkins-hbase16:36183] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-25 22:04:03,299 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-25 22:04:03,305 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-25 22:04:03,305 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-25 22:04:03,305 DEBUG [M:0;jenkins-hbase16:36183] zookeeper.ZKUtil(398): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-25 22:04:03,305 WARN [M:0;jenkins-hbase16:36183] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-25 22:04:03,305 INFO [M:0;jenkins-hbase16:36183] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-25 22:04:03,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-25 22:04:03,305 INFO [M:0;jenkins-hbase16:36183] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-25 22:04:03,306 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-25 22:04:03,306 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:04:03,306 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:04:03,306 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-25 22:04:03,306 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:04:03,306 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.25 KB heapSize=452.41 KB 2023-09-25 22:04:03,325 INFO [M:0;jenkins-hbase16:36183] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.25 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f30ca786291e40828cf7ab6caef0c8a3 2023-09-25 22:04:03,329 INFO [M:0;jenkins-hbase16:36183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f30ca786291e40828cf7ab6caef0c8a3 2023-09-25 22:04:03,330 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f30ca786291e40828cf7ab6caef0c8a3 as hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f30ca786291e40828cf7ab6caef0c8a3 2023-09-25 22:04:03,334 INFO [M:0;jenkins-hbase16:36183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f30ca786291e40828cf7ab6caef0c8a3 2023-09-25 22:04:03,334 INFO [M:0;jenkins-hbase16:36183] regionserver.HStore(1080): Added hdfs://localhost:44421/user/jenkins/test-data/85486cf0-7b12-3ea5-4409-23226aca5e15/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f30ca786291e40828cf7ab6caef0c8a3, entries=119, sequenceid=899, filesize=28.7 K 2023-09-25 22:04:03,335 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegion(2948): Finished flush of dataSize ~376.25 KB/385280, heapSize ~452.40 KB/463256, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-09-25 22:04:03,336 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-25 22:04:03,336 DEBUG [M:0;jenkins-hbase16:36183] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-25 22:04:03,339 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-25 22:04:03,339 INFO [M:0;jenkins-hbase16:36183] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-25 22:04:03,340 INFO [M:0;jenkins-hbase16:36183] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:36183 2023-09-25 22:04:03,346 DEBUG [M:0;jenkins-hbase16:36183] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase16.apache.org,36183,1695679300385 already deleted, retry=false 2023-09-25 22:04:03,372 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,372 INFO [RS:0;jenkins-hbase16:40943] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,40943,1695679301586; zookeeper connection closed. 2023-09-25 22:04:03,372 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x100e51bb2a50001, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,372 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d5df824] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d5df824 2023-09-25 22:04:03,472 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,472 INFO [M:0;jenkins-hbase16:36183] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,36183,1695679300385; zookeeper connection closed. 2023-09-25 22:04:03,472 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): master:36183-0x100e51bb2a50000, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,572 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,572 INFO [RS:1;jenkins-hbase16:33807] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,33807,1695679301636; zookeeper connection closed. 2023-09-25 22:04:03,573 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:33807-0x100e51bb2a50002, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,573 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1fad531a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1fad531a 2023-09-25 22:04:03,673 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,673 DEBUG [Listener at localhost/42335-EventThread] zookeeper.ZKWatcher(600): regionserver:37003-0x100e51bb2a50003, quorum=127.0.0.1:60419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-25 22:04:03,673 INFO [RS:2;jenkins-hbase16:37003] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,37003,1695679301677; zookeeper connection closed. 2023-09-25 22:04:03,675 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d1b4bf4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d1b4bf4 2023-09-25 22:04:03,676 INFO [Listener at jenkins-hbase16.apache.org/37563] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-25 22:04:03,677 WARN [Listener at jenkins-hbase16.apache.org/37563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-25 22:04:03,748 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-25 22:04:03,856 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-25 22:04:03,856 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1170359064-188.40.62.62-1695679295982 (Datanode Uuid 6a4c0343-cd09-42e1-9850-59acf4eefd7e) service to localhost/127.0.0.1:44421 2023-09-25 22:04:03,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data5/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:03,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data6/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:03,863 WARN [Listener at jenkins-hbase16.apache.org/37563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-25 22:04:03,866 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-25 22:04:03,973 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-25 22:04:03,973 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1170359064-188.40.62.62-1695679295982 (Datanode Uuid 50fd8cc2-dbd5-45b8-8ad0-98858d7734e8) service to localhost/127.0.0.1:44421 2023-09-25 22:04:03,975 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data3/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:03,976 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data4/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:03,977 WARN [Listener at jenkins-hbase16.apache.org/37563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-25 22:04:03,978 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-25 22:04:04,081 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-25 22:04:04,081 WARN [BP-1170359064-188.40.62.62-1695679295982 heartbeating to localhost/127.0.0.1:44421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1170359064-188.40.62.62-1695679295982 (Datanode Uuid 83cb8df3-cf83-4120-954f-b742be24602f) service to localhost/127.0.0.1:44421 2023-09-25 22:04:04,082 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data1/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:04,083 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/397e310d-e036-98aa-4440-8a7f3c6d7551/cluster_8462537e-99f8-960b-67e4-0fa61009b150/dfs/data/data2/current/BP-1170359064-188.40.62.62-1695679295982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-25 22:04:04,105 INFO [Listener at jenkins-hbase16.apache.org/37563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-25 22:04:04,233 INFO [Listener at jenkins-hbase16.apache.org/37563] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-25 22:04:04,707 INFO [Listener at jenkins-hbase16.apache.org/37563] hbase.HBaseTestingUtility(1293): Minicluster is down